Apr 16 19:35:38 devstack cinder-volume[72877]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 16 19:35:38 devstack cinder-volume[72877]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 19:35:38 devstack cinder-volume[72877]: we strongly recommend against using it for new projects. Apr 16 19:35:38 devstack cinder-volume[72877]: If you are already using Eventlet, we recommend migrating to a different Apr 16 19:35:38 devstack cinder-volume[72877]: framework. For more detail see Apr 16 19:35:38 devstack cinder-volume[72877]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 19:35:38 devstack cinder-volume[72877]: import eventlet # noqa Apr 16 19:35:40 devstack cinder-volume[72877]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72877) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 19:35:40 devstack cinder-volume[72877]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72877) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 19:35:40 devstack cinder-volume[72877]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72877) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 19:35:40 devstack cinder-volume[72877]: INFO dbcounter [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Registered counter for database cinder Apr 16 19:35:40 devstack cinder-volume[72877]: DEBUG oslo_db.sqlalchemy.engines [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72877) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 19:35:40 devstack cinder-volume[72877]: DEBUG dbcounter [-] [72877] Writer thread running {{(pid=72877) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 19:35:40 devstack cinder-volume[72877]: INFO cinder.rpc [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 16 19:35:40 devstack cinder-volume[72877]: INFO cinder.rpc [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 16 19:35:40 devstack cinder-volume[72877]: DEBUG oslo_db.sqlalchemy.engines [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72877) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 19:35:40 devstack cinder-volume[72877]: INFO cinder.volume.manager [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Determined volume DB was empty at startup. Apr 16 19:35:40 devstack cinder-volume[72877]: DEBUG cinder.volume.manager [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72877) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 16 19:35:40 devstack cinder-volume[72877]: INFO cinder.volume.manager [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 16 19:35:40 devstack cinder-volume[72877]: WARNING stevedore.named [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 19:35:40 devstack cinder-volume[72877]: WARNING castellan.key_manager [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 19:35:40 devstack cinder-volume[72877]: WARNING cinder.keymgr.conf_key_mgr [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 19:35:40 devstack cinder-volume[72877]: DEBUG cinder.volume.drivers.lvm [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72877) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 16 19:35:40 devstack cinder-volume[72877]: DEBUG oslo_concurrency.processutils [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72877) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_concurrency.processutils [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] CMD "cinder-rtstool verify" returned: 0 in 0.235s {{(pid=72877) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_db.sqlalchemy.engines [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72877) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 19:35:41 devstack cinder-volume[72877]: INFO cinder.rpc [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 16 19:35:41 devstack cinder-volume[72877]: INFO cinder.rpc [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 16 19:35:41 devstack cinder-volume[72877]: WARNING stevedore.named [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 19:35:41 devstack cinder-volume[72877]: WARNING castellan.key_manager [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 19:35:41 devstack cinder-volume[72877]: INFO cinder.volume.manager [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_db.sqlalchemy.engines [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72877) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 19:35:41 devstack cinder-volume[72877]: INFO oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Starting 1 workers Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Started child 72984 {{(pid=72877) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Full set of CONF: {{(pid=72877) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] ******************************************************************************** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Configuration options gathered from: {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] ================================================================================ {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] allow_availability_zone_fallback = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] allow_compression_on_image_upload = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] allowed_direct_url_schemes = [] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] api_rate_limit = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] auth_strategy = keystone {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] az_cache_duration = 3600 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_availability_zone = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_host = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_name = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_stats_polling_interval = 60 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backup_api_class = cinder.backup.api.API {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backup_name_template = backup-%s {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backup_use_same_host = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backup_use_temp_snapshot = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] chap_password = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] chap_username = {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cinder_internal_tenant_project_id = cab12be7c52643e8869df6c565453cfc {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72984]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cinder_internal_tenant_user_id = 8169aa2497c44a9c8aeb1a3831e5d45c {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cloned_volume_same_az = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cluster = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] compression_format = gzip {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] compute_api_class = cinder.compute.nova.API {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] config_dir = [] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] config_source = [] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] control_exchange = openstack {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] debug = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] default_availability_zone = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] default_group_type = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] default_volume_type = lvmdriver-1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] disk_geometry = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] driver_client_cert = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] driver_client_cert_key = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] driver_data_namespace = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] driver_ssl_cert_path = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] driver_ssl_cert_verify = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] driver_use_ssl = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] enable_force_upload = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] enable_new_services = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] enable_unsupported_driver = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] enabled_backends = ['lvmdriver-1'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] enforce_multipath_for_image_xfer = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] filter_function = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] glance_api_insecure = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] glance_api_servers = ['http://192.168.122.11/image'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] glance_api_ssl_compression = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] glance_ca_certificates_file = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] glance_catalog_info = image:glance:publicURL {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] glance_certfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] glance_keyfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] glance_num_retries = 3 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] glance_request_timeout = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] goodness_function = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] graceful_shutdown_timeout = 5 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] group_api_class = cinder.group.api.API {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] host = devstack {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] image_compress_on_upload = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] image_conversion_address_space_limit = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] image_conversion_cpu_limit = 60 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] image_conversion_disable = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] image_upload_use_cinder_backend = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] image_upload_use_internal_tenant = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] image_volume_cache_enabled = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72984]: INFO cinder.volume.manager [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] image_volume_cache_max_count = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] image_volume_cache_max_size_gb = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] init_host_max_objects_retrieval = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] instance_format = [instance: %(uuid)s] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] iscsi_target_flags = {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] iscsi_write_cache = on {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] iser_helper = tgtadm {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] iser_ip_address = 192.168.122.11 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] iser_port = 3260 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] log_color = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] log_config_append = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] log_dir = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] log_file = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] log_options = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] log_rotate_interval = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] log_rotate_interval_type = days {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] log_rotation_type = none {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] max_age = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] max_logfile_count = 30 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] max_logfile_size_mb = 200 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] max_over_subscription_ratio = 20.0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] message_reap_interval = 86400 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] message_ttl = 2592000 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] migration_create_volume_timeout_secs = 300 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] monkey_patch = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] monkey_patch_modules = [] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] my_ip = 192.168.122.11 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] no_snapshot_gb_quota = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] num_iser_scan_tries = 3 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] num_shell_tries = 3 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] num_volume_device_scan_tries = 3 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] nvmeof_conn_info_version = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] nvmet_ns_id = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] nvmet_port_id = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] osapi_max_limit = 1000 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] osapi_volume_ext_list = [] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] osapi_volume_listen = 0.0.0.0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] osapi_volume_listen_port = 8776 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] osapi_volume_use_ssl = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] osapi_volume_workers = 2 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] per_volume_size_limit = -1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] periodic_fuzzy_delay = 60 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] periodic_interval = 60 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] project_id_regex = [0-9a-f\-]+ {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] public_endpoint = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] publish_errors = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] quota_backup_gigabytes = 1000 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] quota_backups = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] quota_gigabytes = 1000 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] quota_groups = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] quota_snapshots = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] quota_volumes = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] rate_limit_burst = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] rate_limit_except_level = CRITICAL {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] rate_limit_interval = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] reinit_driver_count = 3 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] replication_device = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] report_discard_supported = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] report_interval = 120 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] reservation_clean_interval = 86400 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] reservation_expire = 86400 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] reserved_image_namespaces = [] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] reserved_percentage = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] rpc_response_timeout = 120 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] run_external_periodic_tasks = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] scst_target_driver = iscsi {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] scst_target_iqn_name = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] service_down_time = 720 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] shell_completion = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] snapshot_name_template = snapshot-%s {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] snapshot_same_host = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] split_loggers = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] state_path = /opt/stack/data/cinder {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] storage_availability_zone = nova {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] storage_protocol = iSCSI {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] syslog_log_facility = LOG_USER {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] target_helper = lioadm {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] target_ip_address = 192.168.122.11 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] target_port = 3260 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] target_protocol = iscsi {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] target_secondary_ip_addresses = [] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] trace_flags = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] transfer_api_class = cinder.transfer.api.API {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] transport_url = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] until_refresh = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] use_chap_auth = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] use_default_quota_class = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] use_journal = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] use_json = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] use_multipath_for_image_xfer = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] use_stderr = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] use_syslog = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] verify_glance_signatures = enabled {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] volume_api_class = cinder.volume.api.API {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] volume_backend_name = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] volume_clear = zero {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] volume_clear_ionice = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] volume_clear_size = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] volume_copy_bps_limit = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] volume_dd_blocksize = 1M {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] volume_name_template = volume-%s {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] volume_service_inithost_offload = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] volume_usage_audit_period = month {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] zoning_mode = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_concurrency.disable_process_locking = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.admin_password = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.admin_token = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.admin_user = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.auth_admin_prefix = {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.auth_port = 35357 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.auth_protocol = https {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.auth_section = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.auth_type = password {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.auth_uri = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.auth_version = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.cache = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.certfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.delay_auth_decision = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.http_connect_timeout = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.identity_uri = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.include_service_catalog = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.insecure = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.interface = public {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.keyfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.memcache_password = {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.memcache_username = {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.region_name = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.service_token_roles_required = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.service_type = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.token_cache_time = 300 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.11/identity {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.backend = dogpile.cache.null {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.backend_argument = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.backend_expiration_time = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.config_prefix = cache.oslo {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.debug_cache_backend = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.enable_retry_client = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.enable_socket_keepalive = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.enabled = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.enforce_fips_mode = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.expiration_time = 600 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.hashclient_retry_attempts = 2 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.memcache_dead_retry = 300 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.memcache_pool_maxsize = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.memcache_sasl_enabled = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.password = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.proxies = [] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.redis_db = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.redis_sentinel_service_name = mymaster {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.redis_server = localhost:6379 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.retry_attempts = 2 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.retry_delay = 0.0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.socket_keepalive_count = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.socket_keepalive_idle = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.socket_keepalive_interval = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.socket_timeout = 1.0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.tls_allowed_ciphers = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.tls_cafile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.tls_certfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.tls_enabled = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.tls_keyfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cache.username = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] coordination.backend_url = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] database.asyncio_connection = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] database.asyncio_slave_connection = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] database.backend = sqlalchemy {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] database.connection = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] database.connection_debug = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] database.connection_parameters = {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] database.connection_recycle_time = 3600 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] database.connection_trace = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] database.db_inc_retry_interval = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] database.db_max_retries = 20 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] database.db_max_retry_interval = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] database.db_retry_interval = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] database.max_overflow = 50 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] database.max_pool_size = 5 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] database.max_retries = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] database.mysql_wsrep_sync_wait = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] database.pool_timeout = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] database.retry_interval = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack sudo[72988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] database.slave_connection = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack sudo[72988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] database.sqlite_synchronous = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] database.synchronous_reader = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] database.use_db_reconnect = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] profiler.connection_string = messaging:// {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] profiler.enabled = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] profiler.es_doc_type = notification {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] profiler.es_scroll_size = 10000 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] profiler.es_scroll_time = 2m {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] profiler.filter_error_trace = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] profiler.hmac_keys = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] profiler.sentinel_service_name = mymaster {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] profiler.socket_timeout = 0.1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] profiler.trace_requests = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] profiler.trace_sqlalchemy = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] profiler_jaeger.process_tags = {} {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] profiler_jaeger.service_name_prefix = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] profiler_otlp.service_name_prefix = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_policy.enforce_new_defaults = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: WARNING oslo_config.cfg [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_policy.enforce_scope = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_policy.policy_default_rule = default {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_policy.policy_file = policy.yaml {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_policy.remote_timeout = 60.0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] privsep_osbrick.group = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] privsep_osbrick.helper_command = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] privsep_osbrick.user = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cinder_sys_admin.group = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cinder_sys_admin.helper_command = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] cinder_sys_admin.user = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] service_user.auth_section = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] service_user.auth_type = password {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] service_user.cafile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] service_user.certfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] service_user.collect_timing = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] service_user.insecure = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] service_user.keyfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] service_user.send_service_user_token = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] service_user.split_loggers = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] service_user.timeout = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] glance.auth_section = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] glance.auth_type = password {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] glance.certfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] glance.collect_timing = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] glance.insecure = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] glance.keyfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] glance.region_name = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] glance.split_loggers = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] glance.timeout = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.backend_availability_zone = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.chap_password = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.chap_username = {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.disk_geometry = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.driver_client_cert = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.driver_client_cert_key = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.driver_data_namespace = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.driver_use_ssl = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.enable_unsupported_driver = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.extra_capabilities = {} {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.filter_function = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.goodness_function = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.iscsi_target_flags = {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.iscsi_write_cache = on {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.iser_helper = tgtadm {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.iser_ip_address = 192.168.122.11 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.iser_port = 3260 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.lvm_mirrors = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.lvm_share_target = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.lvm_type = auto {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.num_shell_tries = 3 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.nvmet_port_id = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.replication_device = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.report_discard_supported = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.reserved_percentage = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.scst_target_driver = iscsi {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.scst_target_iqn_name = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.storage_protocol = iSCSI {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.target_helper = tgtadm {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.target_ip_address = 192.168.122.11 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.target_port = 3260 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.target_protocol = iscsi {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.trace_flags = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.unique_fqdn_network = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.use_chap_auth = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.volume_backend_name = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.volume_clear = zero {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.volume_clear_ionice = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.volume_clear_size = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.volume_group = cinder-volumes {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_reports.file_event_handler = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_reports.log_dir = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.backend_availability_zone = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.backend_host = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.chap_password = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.chap_username = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.chiscsi_conf = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.disk_geometry = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.driver_client_cert = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.driver_data_namespace = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.driver_use_ssl = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.extra_capabilities = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.filter_function = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.goodness_function = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.iser_helper = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.iser_ip_address = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.iser_port = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.iser_target_prefix = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.lvm_conf_file = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.lvm_mirrors = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.lvm_share_target = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.lvm_type = auto {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.num_shell_tries = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.nvmet_port_id = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.replication_device = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.report_discard_supported = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.reserved_percentage = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.scst_target_driver = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.storage_protocol = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.target_helper = lioadm {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.target_ip_address = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.target_port = 3260 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.target_protocol = iscsi {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.trace_flags = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.use_chap_auth = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.volume_clear = zero {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.volume_clear_size = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] lvmdriver-1.volumes_dir = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.ssl = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.ssl_version = {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_notifications.driver = [] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_notifications.retry = -1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] oslo_messaging_notifications.transport_url = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] key_manager.fixed_key = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] barbican.barbican_api_version = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] barbican.barbican_endpoint = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] barbican.barbican_endpoint_type = public {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] barbican.barbican_region_name = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] barbican.cafile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] barbican.certfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] barbican.collect_timing = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] barbican.insecure = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] barbican.keyfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] barbican.number_of_retries = 60 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] barbican.retry_delay = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] barbican.send_service_user_token = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] barbican.split_loggers = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] barbican.timeout = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] barbican.verify_ssl = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] barbican.verify_ssl_path = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] barbican_service_user.auth_section = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] barbican_service_user.auth_type = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] barbican_service_user.cafile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] barbican_service_user.certfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] barbican_service_user.collect_timing = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] barbican_service_user.insecure = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] barbican_service_user.keyfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] barbican_service_user.split_loggers = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] barbican_service_user.timeout = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] vault.approle_role_id = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] vault.approle_secret_id = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] vault.kv_mountpoint = secret {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] vault.kv_path = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] vault.kv_version = 2 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] vault.namespace = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] vault.root_token_id = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] vault.ssl_ca_crt_file = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] vault.timeout = 60.0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] vault.use_ssl = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:35:41 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] ******************************************************************************** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 16 19:35:41 devstack sudo[72988]: pam_unix(sudo:session): session closed for user root Apr 16 19:35:41 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.580s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:41 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:41 devstack sudo[73093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 19:35:41 devstack sudo[73093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:35:42 devstack sudo[73093]: pam_unix(sudo:session): session closed for user root Apr 16 19:35:42 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.517s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:42 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 19:35:42 devstack cinder-volume[72984]: INFO cinder.brick.local_dev.lvm [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 16 19:35:42 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:42 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.012s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:42 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:42 devstack sudo[73341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 19:35:42 devstack sudo[73341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:35:43 devstack sudo[73341]: pam_unix(sudo:session): session closed for user root Apr 16 19:35:43 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.599s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:43 devstack cinder-volume[72984]: DEBUG cinder.brick.local_dev.lvm [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72984) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 16 19:35:43 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:43 devstack sudo[73509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 19:35:43 devstack sudo[73509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:35:43 devstack sudo[73509]: pam_unix(sudo:session): session closed for user root Apr 16 19:35:43 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.823s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:43 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:43 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:43 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:43 devstack sudo[73654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 19:35:43 devstack sudo[73654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:35:44 devstack sudo[73654]: pam_unix(sudo:session): session closed for user root Apr 16 19:35:44 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.522s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:44 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:44 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:44 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:44 devstack sudo[73682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 16 19:35:44 devstack sudo[73682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:35:44 devstack sudo[73682]: pam_unix(sudo:session): session closed for user root Apr 16 19:35:44 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.471s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:44 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:44 devstack sudo[73685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 19:35:44 devstack sudo[73685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:35:45 devstack sudo[73685]: pam_unix(sudo:session): session closed for user root Apr 16 19:35:45 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.473s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:45 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:45 devstack sudo[73690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 19:35:45 devstack sudo[73690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:35:45 devstack sudo[73690]: pam_unix(sudo:session): session closed for user root Apr 16 19:35:45 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.469s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:45 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:45 devstack sudo[73693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 19:35:45 devstack sudo[73693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:35:46 devstack sudo[73693]: pam_unix(sudo:session): session closed for user root Apr 16 19:35:46 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.499s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:46 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:46 devstack sudo[73698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 19:35:46 devstack sudo[73698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:35:46 devstack sudo[73698]: pam_unix(sudo:session): session closed for user root Apr 16 19:35:46 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.479s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:46 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:46 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:46 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:46 devstack sudo[73705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 19:35:46 devstack sudo[73705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:35:47 devstack sudo[73705]: pam_unix(sudo:session): session closed for user root Apr 16 19:35:47 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.482s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:47 devstack cinder-volume[72984]: INFO cinder.volume.drivers.lvm [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 16 19:35:47 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:47 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:47 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:47 devstack sudo[73715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 19:35:47 devstack sudo[73715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:35:47 devstack sudo[73715]: pam_unix(sudo:session): session closed for user root Apr 16 19:35:47 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.494s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:47 devstack cinder-volume[72984]: DEBUG cinder.volume.drivers.lvm [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Updating volume stats {{(pid=72984) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 19:35:47 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:47 devstack sudo[73827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 19:35:47 devstack sudo[73827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:35:48 devstack sudo[73827]: pam_unix(sudo:session): session closed for user root Apr 16 19:35:48 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:48 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:48 devstack sudo[73833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 19:35:48 devstack sudo[73833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:35:48 devstack sudo[73833]: pam_unix(sudo:session): session closed for user root Apr 16 19:35:48 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.442s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:48 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:48 devstack sudo[73972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 19:35:48 devstack sudo[73972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:35:49 devstack sudo[73972]: pam_unix(sudo:session): session closed for user root Apr 16 19:35:49 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.434s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:49 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:49 devstack sudo[73977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 19:35:49 devstack sudo[73977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:35:49 devstack sudo[73977]: pam_unix(sudo:session): session closed for user root Apr 16 19:35:49 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:49 devstack cinder-volume[72984]: INFO cinder.volume.driver [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Driver hasn't implemented _init_vendor_properties() Apr 16 19:35:49 devstack cinder-volume[72984]: DEBUG cinder.volume.driver [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72984) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 16 19:35:49 devstack cinder-volume[72984]: DEBUG oslo_db.sqlalchemy.engines [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72984) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 19:35:49 devstack cinder-volume[72984]: DEBUG dbcounter [-] [72984] Writer thread running {{(pid=72984) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 19:35:49 devstack cinder-volume[72984]: DEBUG cinder.db.sqlalchemy.api [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Building query based on filter {{(pid=72984) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 16 19:35:49 devstack cinder-volume[72984]: DEBUG cinder.image.image_utils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72984) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 16 19:35:49 devstack cinder-volume[72984]: INFO cinder.keymgr.migration [None req-98e3d6d7-a136-4b20-a1cd-964a60e1c461 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 16 19:35:49 devstack cinder-volume[72984]: DEBUG cinder.volume.drivers.lvm [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Updating volume stats {{(pid=72984) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 19:35:49 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:49 devstack sudo[73982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 19:35:49 devstack sudo[73982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:35:50 devstack sudo[73982]: pam_unix(sudo:session): session closed for user root Apr 16 19:35:50 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.469s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:50 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:50 devstack sudo[73985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 19:35:50 devstack sudo[73985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:35:50 devstack sudo[73985]: pam_unix(sudo:session): session closed for user root Apr 16 19:35:50 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.486s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:50 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:50 devstack sudo[73991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 19:35:50 devstack sudo[73991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:35:51 devstack cinder-volume[72877]: DEBUG dbcounter [-] [72877] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72877) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:35:51 devstack sudo[73991]: pam_unix(sudo:session): session closed for user root Apr 16 19:35:51 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.522s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:51 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:51 devstack sudo[74003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 19:35:51 devstack sudo[74003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:35:51 devstack sudo[74003]: pam_unix(sudo:session): session closed for user root Apr 16 19:35:51 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.504s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:51 devstack cinder-volume[72984]: DEBUG cinder.manager [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Notifying Schedulers of capabilities ... {{(pid=72984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:35:51 devstack cinder-volume[72984]: INFO cinder.volume.manager [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Driver initialization completed successfully. Apr 16 19:35:51 devstack cinder-volume[72984]: INFO cinder.manager [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Initiating service 2 cleanup Apr 16 19:35:51 devstack cinder-volume[72984]: INFO cinder.manager [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Service 2 cleanup completed. Apr 16 19:35:51 devstack cinder-volume[72984]: DEBUG cinder.service [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Creating RPC server for service cinder-volume {{(pid=72984) start /opt/stack/cinder/cinder/service.py:231}} Apr 16 19:35:51 devstack cinder-volume[72984]: DEBUG cinder.service [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72984) start /opt/stack/cinder/cinder/service.py:237}} Apr 16 19:35:51 devstack cinder-volume[72984]: INFO cinder.volume.manager [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 16 19:35:51 devstack cinder-volume[72984]: DEBUG cinder.volume.drivers.lvm [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Updating volume stats {{(pid=72984) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 19:35:51 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:51 devstack sudo[74008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 19:35:51 devstack sudo[74008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:35:52 devstack sudo[74008]: pam_unix(sudo:session): session closed for user root Apr 16 19:35:52 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.505s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:52 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:52 devstack sudo[74014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 19:35:52 devstack sudo[74014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:35:52 devstack sudo[74014]: pam_unix(sudo:session): session closed for user root Apr 16 19:35:52 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.449s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:52 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:52 devstack sudo[74071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 19:35:52 devstack sudo[74071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:35:53 devstack sudo[74071]: pam_unix(sudo:session): session closed for user root Apr 16 19:35:53 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.420s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:53 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:35:53 devstack sudo[74075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 19:35:53 devstack sudo[74075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:35:53 devstack sudo[74075]: pam_unix(sudo:session): session closed for user root Apr 16 19:35:53 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:35:53 devstack cinder-volume[72984]: INFO cinder.volume.manager [None req-2a806262-9238-45b7-9111-0cdc34c3b38e None None] Driver post RPC initialization completed successfully. Apr 16 19:36:03 devstack cinder-volume[72984]: DEBUG dbcounter [-] [72984] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72984) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:36:03 devstack cinder-volume[72984]: DEBUG dbcounter [-] [72984] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=72984) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:36:49 devstack cinder-volume[72984]: DEBUG oslo_service.periodic_task [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72984) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 19:36:49 devstack cinder-volume[72984]: DEBUG cinder.volume.drivers.lvm [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] Updating volume stats {{(pid=72984) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 19:36:49 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:36:49 devstack sudo[78791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 19:36:49 devstack sudo[78791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:36:50 devstack sudo[78791]: pam_unix(sudo:session): session closed for user root Apr 16 19:36:50 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.466s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:36:50 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:36:50 devstack sudo[78799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 19:36:50 devstack sudo[78799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:36:50 devstack sudo[78799]: pam_unix(sudo:session): session closed for user root Apr 16 19:36:50 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:36:50 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:36:50 devstack sudo[78803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 19:36:50 devstack sudo[78803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:36:51 devstack sudo[78803]: pam_unix(sudo:session): session closed for user root Apr 16 19:36:51 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.483s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:36:51 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:36:51 devstack sudo[78812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 19:36:51 devstack sudo[78812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:36:51 devstack sudo[78812]: pam_unix(sudo:session): session closed for user root Apr 16 19:36:51 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:36:51 devstack cinder-volume[72984]: DEBUG cinder.manager [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] Notifying Schedulers of capabilities ... {{(pid=72984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:37:49 devstack cinder-volume[72984]: DEBUG oslo_service.periodic_task [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72984) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 19:37:49 devstack cinder-volume[72984]: DEBUG cinder.volume.drivers.lvm [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] Updating volume stats {{(pid=72984) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 19:37:49 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:37:49 devstack sudo[79181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 19:37:49 devstack sudo[79181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:37:50 devstack sudo[79181]: pam_unix(sudo:session): session closed for user root Apr 16 19:37:50 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.543s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:37:50 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:37:50 devstack sudo[79184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 19:37:50 devstack sudo[79184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:37:50 devstack sudo[79184]: pam_unix(sudo:session): session closed for user root Apr 16 19:37:50 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.563s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:37:50 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:37:50 devstack sudo[79188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 19:37:50 devstack sudo[79188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:37:51 devstack sudo[79188]: pam_unix(sudo:session): session closed for user root Apr 16 19:37:51 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.503s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:37:51 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:37:51 devstack sudo[79265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 19:37:51 devstack sudo[79265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:37:51 devstack sudo[79265]: pam_unix(sudo:session): session closed for user root Apr 16 19:37:51 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.495s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:37:51 devstack cinder-volume[72984]: DEBUG cinder.manager [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] Notifying Schedulers of capabilities ... {{(pid=72984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:38:03 devstack cinder-volume[72984]: DEBUG dbcounter [-] [72984] Writing DB stats cinder:SELECT=1 {{(pid=72984) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:38:03 devstack cinder-volume[72984]: DEBUG dbcounter [-] [72984] Writing DB stats cinder:UPDATE=1 {{(pid=72984) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:38:49 devstack cinder-volume[72984]: DEBUG oslo_service.periodic_task [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72984) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 19:38:49 devstack cinder-volume[72984]: DEBUG cinder.volume.drivers.lvm [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] Updating volume stats {{(pid=72984) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 19:38:49 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:38:49 devstack sudo[81375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 19:38:49 devstack sudo[81375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:38:50 devstack sudo[81375]: pam_unix(sudo:session): session closed for user root Apr 16 19:38:50 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.527s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:38:50 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:38:50 devstack sudo[81419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 19:38:50 devstack sudo[81419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:38:50 devstack sudo[81419]: pam_unix(sudo:session): session closed for user root Apr 16 19:38:50 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.493s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:38:50 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:38:50 devstack sudo[81445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 19:38:50 devstack sudo[81445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:38:51 devstack sudo[81445]: pam_unix(sudo:session): session closed for user root Apr 16 19:38:51 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.509s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:38:51 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:38:51 devstack sudo[81460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 19:38:51 devstack sudo[81460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:38:51 devstack sudo[81460]: pam_unix(sudo:session): session closed for user root Apr 16 19:38:51 devstack cinder-volume[72984]: DEBUG oslo_concurrency.processutils [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.484s {{(pid=72984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:38:51 devstack cinder-volume[72984]: DEBUG cinder.manager [None req-fc35a7dd-1a43-45b4-b950-89f753849292 None None] Notifying Schedulers of capabilities ... {{(pid=72984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:39:17 devstack cinder-volume[72877]: INFO oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Caught SIGTERM, stopping children Apr 16 19:39:17 devstack cinder-volume[72877]: DEBUG oslo_concurrency.lockutils [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Acquiring lock "singleton_lock" {{(pid=72877) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 19:39:17 devstack cinder-volume[72877]: DEBUG oslo_concurrency.lockutils [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Acquired lock "singleton_lock" {{(pid=72877) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 19:39:17 devstack cinder-volume[72877]: DEBUG oslo_concurrency.lockutils [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Releasing lock "singleton_lock" {{(pid=72877) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 19:39:17 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Stop services. {{(pid=72877) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 16 19:39:17 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Killing children. {{(pid=72877) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 16 19:39:17 devstack cinder-volume[72877]: INFO oslo_service.backend._eventlet.service [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Waiting on 1 children to exit Apr 16 19:39:22 devstack cinder-volume[72984]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Apr 16 19:39:22 devstack cinder-volume[82086]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 16 19:39:22 devstack cinder-volume[82086]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 19:39:22 devstack cinder-volume[82086]: we strongly recommend against using it for new projects. Apr 16 19:39:22 devstack cinder-volume[82086]: If you are already using Eventlet, we recommend migrating to a different Apr 16 19:39:22 devstack cinder-volume[82086]: framework. For more detail see Apr 16 19:39:22 devstack cinder-volume[82086]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 19:39:22 devstack cinder-volume[82086]: import eventlet # noqa Apr 16 19:39:24 devstack cinder-volume[82086]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82086) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 19:39:24 devstack cinder-volume[82086]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82086) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 19:39:24 devstack cinder-volume[82086]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82086) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 19:39:25 devstack cinder-volume[82086]: INFO dbcounter [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] Registered counter for database cinder Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_db.sqlalchemy.engines [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82086) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG dbcounter [-] [82086] Writer thread running {{(pid=82086) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 19:39:25 devstack cinder-volume[82086]: INFO cinder.rpc [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 16 19:39:25 devstack cinder-volume[82086]: INFO cinder.rpc [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_db.sqlalchemy.engines [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82086) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 19:39:25 devstack cinder-volume[82086]: INFO cinder.volume.manager [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] Determined volume DB was empty at startup. Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG cinder.volume.manager [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82086) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 16 19:39:25 devstack cinder-volume[82086]: INFO cinder.volume.manager [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 16 19:39:25 devstack cinder-volume[82086]: WARNING stevedore.named [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 19:39:25 devstack cinder-volume[82086]: WARNING castellan.key_manager [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 19:39:25 devstack cinder-volume[82086]: WARNING cinder.keymgr.conf_key_mgr [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 19:39:25 devstack cinder-volume[82086]: INFO cinder.volume.manager [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_db.sqlalchemy.engines [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82086) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 19:39:25 devstack cinder-volume[82086]: INFO oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] Starting 1 workers Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] Started child 82205 {{(pid=82086) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] Full set of CONF: {{(pid=82086) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] ******************************************************************************** {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] Configuration options gathered from: {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 16 19:39:25 devstack cinder-volume[82205]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] ================================================================================ {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] allow_availability_zone_fallback = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] allow_compression_on_image_upload = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] allowed_direct_url_schemes = [] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] api_rate_limit = True {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] auth_strategy = keystone {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_availability_zone = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_host = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_name = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_stats_polling_interval = 60 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backup_api_class = cinder.backup.api.API {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backup_name_template = backup-%s {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backup_use_same_host = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backup_use_temp_snapshot = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] chap_password = **** {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] chap_username = {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cinder_internal_tenant_project_id = cab12be7c52643e8869df6c565453cfc {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cinder_internal_tenant_user_id = 8169aa2497c44a9c8aeb1a3831e5d45c {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cluster = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] compression_format = gzip {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] compute_api_class = cinder.compute.nova.API {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] config_dir = [] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] config_source = [] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] control_exchange = openstack {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] debug = True {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] default_availability_zone = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] default_group_type = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] default_volume_type = QuobyteHD {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] disk_geometry = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] driver_client_cert = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] driver_client_cert_key = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] driver_data_namespace = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] driver_ssl_cert_path = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] driver_ssl_cert_verify = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] driver_use_ssl = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] enable_new_services = True {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] enable_unsupported_driver = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] enabled_backends = ['QuobyteHD'] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] enforce_multipath_for_image_xfer = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] filter_function = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] glance_api_insecure = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82205]: INFO cinder.volume.manager [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] glance_api_servers = ['http://192.168.122.11/image'] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] glance_api_ssl_compression = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] glance_ca_certificates_file = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82205]: DEBUG cinder.volume.drivers.remotefs [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82205) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] glance_catalog_info = image:glance:publicURL {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] glance_certfile = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] glance_keyfile = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] glance_num_retries = 3 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] glance_request_timeout = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] goodness_function = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] graceful_shutdown_timeout = 5 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] group_api_class = cinder.group.api.API {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] host = devstack {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] image_compress_on_upload = True {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] image_conversion_address_space_limit = 1 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] image_conversion_cpu_limit = 60 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] image_conversion_disable = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] image_upload_use_cinder_backend = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] image_upload_use_internal_tenant = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] image_volume_cache_enabled = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] image_volume_cache_max_count = 0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] image_volume_cache_max_size_gb = 0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] init_host_max_objects_retrieval = 0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] instance_format = [instance: %(uuid)s] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] iscsi_target_flags = {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] iscsi_write_cache = on {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] iser_helper = tgtadm {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] iser_ip_address = 192.168.122.11 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] iser_port = 3260 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] log_color = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] log_config_append = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] log_dir = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] log_file = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] log_options = True {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] log_rotate_interval = 1 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] log_rotate_interval_type = days {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] log_rotation_type = none {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] max_age = 0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] max_logfile_count = 30 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] max_logfile_size_mb = 200 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] max_over_subscription_ratio = 20.0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] message_reap_interval = 86400 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] message_ttl = 2592000 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] migration_create_volume_timeout_secs = 300 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] monkey_patch = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] monkey_patch_modules = [] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] my_ip = 192.168.122.11 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] no_snapshot_gb_quota = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] num_iser_scan_tries = 3 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] num_shell_tries = 3 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] num_volume_device_scan_tries = 3 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] nvmeof_conn_info_version = 1 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] nvmet_ns_id = 10 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] nvmet_port_id = 1 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] osapi_max_limit = 1000 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] osapi_volume_ext_list = [] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] osapi_volume_listen_port = 8776 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] osapi_volume_use_ssl = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] osapi_volume_workers = 2 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] per_volume_size_limit = -1 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] periodic_fuzzy_delay = 60 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] periodic_interval = 60 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] public_endpoint = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] publish_errors = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] quota_backup_gigabytes = 1000 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] quota_backups = 10 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] quota_gigabytes = 1000 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] quota_groups = 10 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] quota_snapshots = 10 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] quota_volumes = 10 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] rate_limit_burst = 0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] rate_limit_except_level = CRITICAL {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] rate_limit_interval = 0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] reinit_driver_count = 3 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] replication_device = **** {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] report_discard_supported = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] report_interval = 120 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] reservation_clean_interval = 86400 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] reservation_expire = 86400 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] reserved_image_namespaces = [] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] reserved_percentage = 0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] rpc_response_timeout = 120 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] run_external_periodic_tasks = True {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] scst_target_driver = iscsi {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] scst_target_iqn_name = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] service_down_time = 720 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] shell_completion = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] snapshot_name_template = snapshot-%s {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] split_loggers = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] state_path = /opt/stack/data/cinder {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] storage_availability_zone = nova {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] storage_protocol = iSCSI {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] syslog_log_facility = LOG_USER {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82205]: DEBUG cinder.volume.drivers.quobyte [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82205) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 16 19:39:25 devstack cinder-volume[82205]: WARNING cinder.volume.drivers.quobyte [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 16 19:39:25 devstack cinder-volume[82205]: WARNING cinder.volume.drivers.quobyte [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] target_helper = lioadm {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] target_ip_address = 192.168.122.11 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82205]: DEBUG oslo_concurrency.processutils [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Running cmd (subprocess): mount.quobyte {{(pid=82205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] target_port = 3260 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] target_protocol = iscsi {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] target_secondary_ip_addresses = [] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] trace_flags = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] transport_url = **** {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] until_refresh = 0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] use_chap_auth = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] use_default_quota_class = True {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] use_journal = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] use_json = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] use_multipath_for_image_xfer = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] use_stderr = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] use_syslog = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] verify_glance_signatures = enabled {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] volume_api_class = cinder.volume.api.API {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] volume_backend_name = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] volume_clear = zero {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] volume_clear_ionice = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] volume_clear_size = 0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] volume_copy_bps_limit = 0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] volume_dd_blocksize = 1M {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] volume_name_template = volume-%s {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] volume_service_inithost_offload = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] volume_usage_audit_period = month {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] zoning_mode = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_concurrency.disable_process_locking = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.admin_password = **** {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.admin_token = **** {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.admin_user = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.auth_port = 35357 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.auth_protocol = https {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.auth_section = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.auth_type = password {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.auth_uri = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.auth_version = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.cache = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.certfile = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.identity_uri = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.include_service_catalog = True {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.insecure = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.interface = public {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.keyfile = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.memcache_password = {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.memcache_username = {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.region_name = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.service_type = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.11/identity {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.backend = dogpile.cache.null {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.backend_argument = **** {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.backend_expiration_time = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.config_prefix = cache.oslo {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.debug_cache_backend = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.enable_retry_client = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.enable_socket_keepalive = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.enabled = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.enforce_fips_mode = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.expiration_time = 600 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.hashclient_retry_attempts = 2 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.memcache_dead_retry = 300 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.memcache_pool_maxsize = 10 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.memcache_sasl_enabled = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.password = **** {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.proxies = [] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.redis_db = 0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.redis_server = localhost:6379 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.retry_attempts = 2 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.retry_delay = 0.0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.socket_keepalive_count = 1 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.socket_keepalive_idle = 1 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.socket_keepalive_interval = 1 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.socket_timeout = 1.0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.tls_allowed_ciphers = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.tls_cafile = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.tls_certfile = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.tls_enabled = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.tls_keyfile = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cache.username = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] coordination.backend_url = **** {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] database.asyncio_connection = **** {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:25 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] database.asyncio_slave_connection = **** {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] database.backend = sqlalchemy {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] database.connection = **** {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] database.connection_debug = 0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] database.connection_parameters = {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] database.connection_recycle_time = 3600 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] database.connection_trace = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] database.db_inc_retry_interval = True {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] database.db_max_retries = 20 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] database.db_max_retry_interval = 10 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] database.db_retry_interval = 1 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] database.max_overflow = 50 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] database.max_pool_size = 5 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] database.max_retries = 10 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] database.mysql_wsrep_sync_wait = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] database.pool_timeout = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] database.retry_interval = 10 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack quobyte-client[82206]: Reading configuration file: /etc/quobyte/client.cfg Apr 16 19:39:26 devstack quobyte-client[82206]: Invalid parameters found, error: missing mount point. Apr 16 19:39:26 devstack quobyte-client[82206]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 16 19:39:26 devstack quobyte-client[82206]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] database.slave_connection = **** {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] database.sqlite_synchronous = True {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] database.synchronous_reader = True {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] database.use_db_reconnect = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] profiler.connection_string = messaging:// {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] profiler.enabled = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] profiler.es_doc_type = notification {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] profiler.es_scroll_size = 10000 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] profiler.es_scroll_time = 2m {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] profiler.filter_error_trace = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] profiler.hmac_keys = **** {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] profiler.sentinel_service_name = mymaster {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] profiler.socket_timeout = 0.1 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] profiler.trace_requests = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] profiler.trace_sqlalchemy = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] profiler_jaeger.process_tags = {} {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] profiler_jaeger.service_name_prefix = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] profiler_otlp.service_name_prefix = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_policy.enforce_new_defaults = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: WARNING oslo_config.cfg [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_policy.enforce_scope = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_policy.policy_default_rule = default {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82205]: DEBUG oslo_concurrency.processutils [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] CMD "mount.quobyte" returned: 1 in 0.083s {{(pid=82205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82205]: DEBUG oslo_concurrency.lockutils [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_policy.policy_file = policy.yaml {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82205]: DEBUG oslo_concurrency.lockutils [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:39:26 devstack cinder-volume[82205]: DEBUG cinder.volume.drivers.quobyte [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82205]: INFO cinder.volume.drivers.quobyte [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c ... Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82205]: DEBUG oslo_concurrency.processutils [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 -c /etc/quobyte/client-cinder.cfg {{(pid=82205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] privsep_osbrick.group = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] privsep_osbrick.helper_command = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] privsep_osbrick.user = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cinder_sys_admin.group = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cinder_sys_admin.helper_command = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] cinder_sys_admin.user = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] service_user.auth_section = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] service_user.auth_type = password {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] service_user.cafile = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] service_user.certfile = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] service_user.collect_timing = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] service_user.insecure = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] service_user.keyfile = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] service_user.send_service_user_token = True {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] service_user.split_loggers = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] service_user.timeout = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] glance.auth_section = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] glance.auth_type = password {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] glance.certfile = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] glance.collect_timing = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] glance.insecure = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] glance.keyfile = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] glance.region_name = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] glance.split_loggers = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] glance.timeout = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack sudo[82207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 -c /etc/quobyte/client-cinder.cfg Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.backend_availability_zone = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack sudo[82207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.chap_password = **** {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.chap_username = {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.disk_geometry = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.driver_client_cert = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.driver_client_cert_key = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.driver_data_namespace = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.driver_use_ssl = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.extra_capabilities = {} {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.filter_function = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.goodness_function = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.iscsi_target_flags = {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.iscsi_write_cache = on {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.iser_helper = tgtadm {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.iser_ip_address = 192.168.122.11 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.iser_port = 3260 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.nas_host = {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.nas_login = admin {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.nas_mount_options = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.nas_password = **** {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.nas_private_key = {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.nas_share_path = {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.num_shell_tries = 3 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.quobyte_volume_url = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.replication_device = **** {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.report_discard_supported = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.reserved_percentage = 0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.target_helper = tgtadm {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.target_ip_address = 192.168.122.11 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.target_port = 3260 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.target_protocol = iscsi {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.trace_flags = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.unique_fqdn_network = True {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.use_chap_auth = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.volume_backend_name = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.volume_clear = zero {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.volume_clear_ionice = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.volume_clear_size = 0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_reports.file_event_handler = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_reports.log_dir = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.backend_availability_zone = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.backend_host = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.chap_password = **** {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.chap_username = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.chiscsi_conf = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.disk_geometry = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.driver_client_cert = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.driver_data_namespace = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.driver_use_ssl = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.extra_capabilities = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.filter_function = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.goodness_function = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.iser_helper = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.iser_ip_address = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.iser_port = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.iser_target_prefix = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.nas_host = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.nas_login = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.nas_mount_options = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.nas_password = **** {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.nas_private_key = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.nas_share_path = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.nas_ssh_port = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.num_shell_tries = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.nvmet_port_id = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.replication_device = **** {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.report_discard_supported = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.reserved_percentage = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.scst_target_driver = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.storage_protocol = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.target_helper = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.target_ip_address = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.target_port = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.target_prefix = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.target_protocol = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.trace_flags = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.use_chap_auth = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.volume_clear = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.volume_clear_size = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] QuobyteHD.volumes_dir = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.ssl = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_notifications.driver = [] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_notifications.retry = -1 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] key_manager.fixed_key = **** {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] barbican.barbican_api_version = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] barbican.barbican_endpoint = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] barbican.barbican_endpoint_type = public {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] barbican.barbican_region_name = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] barbican.cafile = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] barbican.certfile = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] barbican.collect_timing = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] barbican.insecure = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] barbican.keyfile = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] barbican.number_of_retries = 60 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] barbican.retry_delay = 1 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] barbican.send_service_user_token = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] barbican.split_loggers = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] barbican.timeout = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] barbican.verify_ssl = True {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] barbican.verify_ssl_path = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] barbican_service_user.auth_section = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] barbican_service_user.auth_type = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] barbican_service_user.cafile = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] barbican_service_user.certfile = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] barbican_service_user.collect_timing = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] barbican_service_user.insecure = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] barbican_service_user.keyfile = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] barbican_service_user.split_loggers = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] barbican_service_user.timeout = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] vault.approle_role_id = **** {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] vault.approle_secret_id = **** {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] vault.kv_mountpoint = secret {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] vault.kv_path = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] vault.kv_version = 2 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] vault.namespace = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] vault.root_token_id = **** {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] vault.ssl_ca_crt_file = None {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] vault.timeout = 60.0 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] vault.use_ssl = False {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:26 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] ******************************************************************************** {{(pid=82086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 16 19:39:26 devstack sudo[82207]: pam_unix(sudo:session): session closed for user root Apr 16 19:39:26 devstack cinder-volume[82205]: DEBUG oslo_concurrency.processutils [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.562s {{(pid=82205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:39:26 devstack cinder-volume[82205]: INFO cinder.volume.drivers.quobyte [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c succeeded Apr 16 19:39:26 devstack cinder-volume[82205]: DEBUG cinder.volume.drivers.quobyte [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:39:26 devstack cinder-volume[82205]: DEBUG oslo_concurrency.lockutils [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.571s {{(pid=82205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:39:26 devstack cinder-volume[82205]: DEBUG oslo_concurrency.processutils [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:39:26 devstack sudo[82276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:39:26 devstack sudo[82276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:39:26 devstack cinder-volume[72984]: DEBUG oslo_concurrency.lockutils [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Acquiring lock "singleton_lock" {{(pid=72984) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 19:39:26 devstack cinder-volume[72984]: DEBUG oslo_concurrency.lockutils [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Acquired lock "singleton_lock" {{(pid=72984) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 19:39:26 devstack cinder-volume[72984]: DEBUG oslo_concurrency.lockutils [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Releasing lock "singleton_lock" {{(pid=72984) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 19:39:26 devstack cinder-volume[72984]: WARNING amqp [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 19:39:26 devstack cinder-volume[72984]: WARNING amqp [None req-4e51c8f6-e932-4890-9dcb-b12e2d5419df None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 19:39:27 devstack sudo[82276]: pam_unix(sudo:session): session closed for user root Apr 16 19:39:27 devstack cinder-volume[82205]: DEBUG oslo_concurrency.processutils [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.456s {{(pid=82205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:39:27 devstack cinder-volume[82205]: INFO cinder.volume.driver [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Driver hasn't implemented _init_vendor_properties() Apr 16 19:39:27 devstack cinder-volume[82205]: DEBUG cinder.volume.driver [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6951370239258, 'free_capacity_gb': 1775.6951370239258, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82205) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 16 19:39:27 devstack cinder-volume[82205]: DEBUG oslo_db.sqlalchemy.engines [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82205) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 19:39:27 devstack cinder-volume[82205]: DEBUG dbcounter [-] [82205] Writer thread running {{(pid=82205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 19:39:27 devstack cinder-volume[82205]: DEBUG cinder.db.sqlalchemy.api [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Building query based on filter {{(pid=82205) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 16 19:39:27 devstack cinder-volume[82205]: DEBUG cinder.image.image_utils [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82205) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 16 19:39:27 devstack cinder-volume[82205]: INFO cinder.keymgr.migration [None req-15d92a44-58cb-43b3-9011-07228a3e1137 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 16 19:39:27 devstack cinder-volume[82205]: DEBUG oslo_concurrency.lockutils [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:39:27 devstack cinder-volume[82205]: DEBUG oslo_concurrency.lockutils [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:39:27 devstack cinder-volume[82205]: DEBUG cinder.volume.drivers.quobyte [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:39:27 devstack cinder-volume[82205]: DEBUG cinder.volume.drivers.quobyte [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:39:27 devstack cinder-volume[82205]: DEBUG oslo_concurrency.lockutils [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:39:27 devstack cinder-volume[82205]: DEBUG oslo_concurrency.processutils [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:39:27 devstack sudo[82279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:39:27 devstack sudo[82279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:39:27 devstack sudo[82279]: pam_unix(sudo:session): session closed for user root Apr 16 19:39:27 devstack cinder-volume[82205]: DEBUG oslo_concurrency.processutils [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.462s {{(pid=82205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:39:27 devstack cinder-volume[82205]: DEBUG cinder.manager [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Notifying Schedulers of capabilities ... {{(pid=82205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:39:27 devstack cinder-volume[82205]: INFO cinder.volume.manager [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Driver initialization completed successfully. Apr 16 19:39:27 devstack cinder-volume[82205]: INFO cinder.manager [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Initiating service 3 cleanup Apr 16 19:39:27 devstack cinder-volume[82205]: INFO cinder.manager [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Service 3 cleanup completed. Apr 16 19:39:27 devstack cinder-volume[82205]: DEBUG cinder.service [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Creating RPC server for service cinder-volume {{(pid=82205) start /opt/stack/cinder/cinder/service.py:231}} Apr 16 19:39:27 devstack cinder-volume[82205]: DEBUG cinder.service [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82205) start /opt/stack/cinder/cinder/service.py:237}} Apr 16 19:39:27 devstack cinder-volume[82205]: INFO cinder.volume.manager [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 16 19:39:27 devstack cinder-volume[82205]: DEBUG oslo_concurrency.lockutils [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:39:27 devstack cinder-volume[82205]: DEBUG oslo_concurrency.lockutils [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:39:27 devstack cinder-volume[82205]: DEBUG cinder.volume.drivers.quobyte [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:39:27 devstack cinder-volume[82205]: DEBUG cinder.volume.drivers.quobyte [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:39:27 devstack cinder-volume[82205]: DEBUG oslo_concurrency.lockutils [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:39:27 devstack cinder-volume[82205]: DEBUG oslo_concurrency.processutils [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:39:27 devstack sudo[82284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:39:27 devstack sudo[82284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:39:28 devstack sudo[82284]: pam_unix(sudo:session): session closed for user root Apr 16 19:39:28 devstack cinder-volume[82205]: DEBUG oslo_concurrency.processutils [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.555s {{(pid=82205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:39:28 devstack cinder-volume[82205]: INFO cinder.volume.manager [None req-01e13344-1d85-4772-8063-c848ddce29d3 None None] Driver post RPC initialization completed successfully. Apr 16 19:39:31 devstack cinder-volume[82205]: DEBUG oslo_concurrency.lockutils [None req-3ac2efb9-a890-4678-a489-24deb8d7f763 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:39:31 devstack cinder-volume[82205]: DEBUG oslo_concurrency.lockutils [None req-3ac2efb9-a890-4678-a489-24deb8d7f763 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:39:31 devstack cinder-volume[82205]: DEBUG cinder.volume.drivers.quobyte [None req-3ac2efb9-a890-4678-a489-24deb8d7f763 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:39:31 devstack cinder-volume[82205]: DEBUG cinder.volume.drivers.quobyte [None req-3ac2efb9-a890-4678-a489-24deb8d7f763 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:39:31 devstack cinder-volume[82205]: DEBUG oslo_concurrency.lockutils [None req-3ac2efb9-a890-4678-a489-24deb8d7f763 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:39:31 devstack cinder-volume[82205]: DEBUG oslo_concurrency.processutils [None req-3ac2efb9-a890-4678-a489-24deb8d7f763 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:39:31 devstack sudo[82349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:39:31 devstack sudo[82349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:39:31 devstack sudo[82349]: pam_unix(sudo:session): session closed for user root Apr 16 19:39:31 devstack cinder-volume[82205]: DEBUG oslo_concurrency.processutils [None req-3ac2efb9-a890-4678-a489-24deb8d7f763 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.398s {{(pid=82205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:39:31 devstack cinder-volume[82205]: DEBUG cinder.manager [None req-3ac2efb9-a890-4678-a489-24deb8d7f763 None None] Notifying Schedulers of capabilities ... {{(pid=82205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:39:34 devstack cinder-volume[82086]: INFO oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] Caught SIGTERM, stopping children Apr 16 19:39:34 devstack cinder-volume[82086]: DEBUG oslo_concurrency.lockutils [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] Acquiring lock "singleton_lock" {{(pid=82086) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 19:39:34 devstack cinder-volume[82086]: DEBUG oslo_concurrency.lockutils [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] Acquired lock "singleton_lock" {{(pid=82086) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 19:39:34 devstack cinder-volume[82086]: DEBUG oslo_concurrency.lockutils [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] Releasing lock "singleton_lock" {{(pid=82086) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 19:39:34 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] Stop services. {{(pid=82086) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 16 19:39:34 devstack cinder-volume[82086]: DEBUG oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] Killing children. {{(pid=82086) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 16 19:39:34 devstack cinder-volume[82086]: INFO oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] Waiting on 1 children to exit Apr 16 19:39:35 devstack cinder-volume[82205]: DEBUG oslo_concurrency.lockutils [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] Acquiring lock "singleton_lock" {{(pid=82205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 19:39:35 devstack cinder-volume[82205]: DEBUG oslo_concurrency.lockutils [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] Acquired lock "singleton_lock" {{(pid=82205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 19:39:35 devstack cinder-volume[82205]: DEBUG oslo_concurrency.lockutils [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] Releasing lock "singleton_lock" {{(pid=82205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 19:39:35 devstack cinder-volume[82205]: WARNING amqp [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 19:39:35 devstack cinder-volume[82205]: WARNING amqp [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 19:39:35 devstack cinder-volume[82086]: INFO oslo_service.backend._eventlet.service [None req-6cf76ebf-7e71-4dc1-91e9-67a3f8500067 None None] Child 82205 exited with status 0 Apr 16 19:39:36 devstack cinder-volume[82427]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 16 19:39:36 devstack cinder-volume[82427]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 19:39:36 devstack cinder-volume[82427]: we strongly recommend against using it for new projects. Apr 16 19:39:36 devstack cinder-volume[82427]: If you are already using Eventlet, we recommend migrating to a different Apr 16 19:39:36 devstack cinder-volume[82427]: framework. For more detail see Apr 16 19:39:36 devstack cinder-volume[82427]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 19:39:36 devstack cinder-volume[82427]: import eventlet # noqa Apr 16 19:39:38 devstack cinder-volume[82427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 19:39:38 devstack cinder-volume[82427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 19:39:38 devstack cinder-volume[82427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 19:39:38 devstack cinder-volume[82427]: INFO dbcounter [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] Registered counter for database cinder Apr 16 19:39:38 devstack cinder-volume[82427]: DEBUG oslo_db.sqlalchemy.engines [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82427) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 19:39:38 devstack cinder-volume[82427]: DEBUG dbcounter [-] [82427] Writer thread running {{(pid=82427) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 19:39:38 devstack cinder-volume[82427]: INFO cinder.rpc [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 16 19:39:38 devstack cinder-volume[82427]: INFO cinder.rpc [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 16 19:39:38 devstack cinder-volume[82427]: DEBUG oslo_db.sqlalchemy.engines [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82427) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 19:39:38 devstack cinder-volume[82427]: INFO cinder.volume.manager [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] Determined volume DB was empty at startup. Apr 16 19:39:38 devstack cinder-volume[82427]: DEBUG cinder.volume.manager [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82427) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 16 19:39:38 devstack cinder-volume[82427]: WARNING stevedore.named [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 19:39:38 devstack cinder-volume[82427]: WARNING castellan.key_manager [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 19:39:38 devstack cinder-volume[82427]: WARNING cinder.keymgr.conf_key_mgr [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 19:39:39 devstack cinder-volume[82427]: INFO cinder.volume.manager [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_db.sqlalchemy.engines [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82427) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 19:39:39 devstack cinder-volume[82427]: INFO oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] Starting 1 workers Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] Started child 82569 {{(pid=82427) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] Full set of CONF: {{(pid=82427) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] ******************************************************************************** {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] Configuration options gathered from: {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] ================================================================================ {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] allow_availability_zone_fallback = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] allow_compression_on_image_upload = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] allowed_direct_url_schemes = [] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] api_rate_limit = True {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] auth_strategy = keystone {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_availability_zone = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_host = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_name = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_stats_polling_interval = 60 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backup_api_class = cinder.backup.api.API {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backup_name_template = backup-%s {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backup_use_same_host = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backup_use_temp_snapshot = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] chap_password = **** {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] chap_username = {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cinder_internal_tenant_project_id = cab12be7c52643e8869df6c565453cfc {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cinder_internal_tenant_user_id = 8169aa2497c44a9c8aeb1a3831e5d45c {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cluster = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] compression_format = gzip {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] compute_api_class = cinder.compute.nova.API {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] config_dir = [] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] config_source = [] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82569]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] control_exchange = openstack {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] debug = True {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] default_availability_zone = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] default_group_type = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] default_volume_type = QuobyteHD {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] disk_geometry = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] driver_client_cert = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] driver_client_cert_key = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] driver_data_namespace = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] driver_ssl_cert_path = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] driver_ssl_cert_verify = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] driver_use_ssl = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] enable_new_services = True {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] enable_unsupported_driver = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] enabled_backends = ['QuobyteHD'] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] enforce_multipath_for_image_xfer = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] filter_function = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] glance_api_insecure = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] glance_api_servers = ['http://192.168.122.11/image'] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] glance_api_ssl_compression = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] glance_ca_certificates_file = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] glance_catalog_info = image:glance:publicURL {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] glance_certfile = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] glance_keyfile = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] glance_num_retries = 3 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] glance_request_timeout = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] goodness_function = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] graceful_shutdown_timeout = 5 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] group_api_class = cinder.group.api.API {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] host = devstack {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] image_compress_on_upload = True {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] image_conversion_address_space_limit = 1 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] image_conversion_cpu_limit = 60 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] image_conversion_disable = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] image_upload_use_cinder_backend = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] image_upload_use_internal_tenant = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] image_volume_cache_enabled = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] image_volume_cache_max_count = 0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] image_volume_cache_max_size_gb = 0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] init_host_max_objects_retrieval = 0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] instance_format = [instance: %(uuid)s] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] iscsi_target_flags = {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] iscsi_write_cache = on {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] iser_helper = tgtadm {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] iser_ip_address = 192.168.122.11 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] iser_port = 3260 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] log_color = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] log_config_append = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] log_dir = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] log_file = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] log_options = True {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] log_rotate_interval = 1 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] log_rotate_interval_type = days {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] log_rotation_type = none {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] max_age = 0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] max_logfile_count = 30 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] max_logfile_size_mb = 200 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] max_over_subscription_ratio = 20.0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] message_reap_interval = 86400 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] message_ttl = 2592000 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] migration_create_volume_timeout_secs = 300 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] monkey_patch = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] monkey_patch_modules = [] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] my_ip = 192.168.122.11 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] no_snapshot_gb_quota = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] num_iser_scan_tries = 3 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] num_shell_tries = 3 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] num_volume_device_scan_tries = 3 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] nvmeof_conn_info_version = 1 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] nvmet_ns_id = 10 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] nvmet_port_id = 1 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] osapi_max_limit = 1000 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] osapi_volume_ext_list = [] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] osapi_volume_listen_port = 8776 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] osapi_volume_use_ssl = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] osapi_volume_workers = 2 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] per_volume_size_limit = -1 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] periodic_fuzzy_delay = 60 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] periodic_interval = 60 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] public_endpoint = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] publish_errors = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] quota_backup_gigabytes = 1000 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] quota_backups = 10 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 16 19:39:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82569) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] quota_gigabytes = 1000 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] quota_groups = 10 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] quota_snapshots = 10 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] quota_volumes = 10 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] rate_limit_burst = 0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] rate_limit_except_level = CRITICAL {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] rate_limit_interval = 0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] reinit_driver_count = 3 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] replication_device = **** {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] report_discard_supported = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] report_interval = 120 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] reservation_clean_interval = 86400 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] reservation_expire = 86400 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] reserved_image_namespaces = [] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] reserved_percentage = 0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] rpc_response_timeout = 120 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] run_external_periodic_tasks = True {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] scst_target_driver = iscsi {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] scst_target_iqn_name = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] service_down_time = 720 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] shell_completion = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] snapshot_name_template = snapshot-%s {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] split_loggers = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] state_path = /opt/stack/data/cinder {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] storage_availability_zone = nova {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] storage_protocol = iSCSI {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] syslog_log_facility = LOG_USER {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] target_helper = lioadm {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] target_ip_address = 192.168.122.11 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] target_port = 3260 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] target_protocol = iscsi {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] target_secondary_ip_addresses = [] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] trace_flags = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] transport_url = **** {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] until_refresh = 0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] use_chap_auth = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] use_default_quota_class = True {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] use_journal = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] use_json = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] use_multipath_for_image_xfer = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] use_stderr = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] use_syslog = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] verify_glance_signatures = enabled {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] volume_api_class = cinder.volume.api.API {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] volume_backend_name = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] volume_clear = zero {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] volume_clear_ionice = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] volume_clear_size = 0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] volume_copy_bps_limit = 0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] volume_dd_blocksize = 1M {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] volume_name_template = volume-%s {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] volume_service_inithost_offload = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] volume_usage_audit_period = month {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] zoning_mode = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_concurrency.disable_process_locking = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.admin_password = **** {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.admin_token = **** {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.admin_user = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.auth_port = 35357 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.auth_protocol = https {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.auth_section = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.auth_type = password {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.auth_uri = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.auth_version = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.cache = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.certfile = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.identity_uri = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.include_service_catalog = True {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.insecure = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.interface = public {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.keyfile = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.memcache_password = {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.memcache_username = {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.region_name = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.service_type = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.11/identity {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.backend = dogpile.cache.null {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.backend_argument = **** {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.backend_expiration_time = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.config_prefix = cache.oslo {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.debug_cache_backend = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.enable_retry_client = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.enable_socket_keepalive = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.enabled = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.enforce_fips_mode = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.expiration_time = 600 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.hashclient_retry_attempts = 2 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.memcache_dead_retry = 300 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.memcache_pool_maxsize = 10 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.memcache_sasl_enabled = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.password = **** {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.proxies = [] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.redis_db = 0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.redis_server = localhost:6379 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.retry_attempts = 2 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.retry_delay = 0.0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.socket_keepalive_count = 1 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.socket_keepalive_idle = 1 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.socket_keepalive_interval = 1 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.socket_timeout = 1.0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.tls_allowed_ciphers = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.tls_cafile = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.tls_certfile = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.tls_enabled = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.tls_keyfile = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cache.username = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] coordination.backend_url = **** {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] database.asyncio_connection = **** {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] database.asyncio_slave_connection = **** {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] database.backend = sqlalchemy {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] database.connection = **** {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] database.connection_debug = 0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] database.connection_parameters = {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] database.connection_recycle_time = 3600 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] database.connection_trace = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] database.db_inc_retry_interval = True {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] database.db_max_retries = 20 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] database.db_max_retry_interval = 10 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] database.db_retry_interval = 1 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] database.max_overflow = 50 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] database.max_pool_size = 5 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] database.max_retries = 10 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] database.mysql_wsrep_sync_wait = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] database.pool_timeout = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] database.retry_interval = 10 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] database.slave_connection = **** {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] database.sqlite_synchronous = True {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] database.synchronous_reader = True {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] database.use_db_reconnect = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] profiler.connection_string = messaging:// {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] profiler.enabled = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] profiler.es_doc_type = notification {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] profiler.es_scroll_size = 10000 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] profiler.es_scroll_time = 2m {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] profiler.filter_error_trace = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] profiler.hmac_keys = **** {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] profiler.sentinel_service_name = mymaster {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] profiler.socket_timeout = 0.1 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] profiler.trace_requests = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82569) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 16 19:39:39 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.quobyte [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 16 19:39:39 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.quobyte [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 16 19:39:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Running cmd (subprocess): mount.quobyte {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] profiler.trace_sqlalchemy = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] profiler_jaeger.process_tags = {} {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] profiler_jaeger.service_name_prefix = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] profiler_otlp.service_name_prefix = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_policy.enforce_new_defaults = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: WARNING oslo_config.cfg [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_policy.enforce_scope = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_policy.policy_default_rule = default {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_policy.policy_file = policy.yaml {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] privsep_osbrick.group = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] privsep_osbrick.helper_command = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] privsep_osbrick.user = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cinder_sys_admin.group = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cinder_sys_admin.helper_command = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] cinder_sys_admin.user = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] service_user.auth_section = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] service_user.auth_type = password {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] service_user.cafile = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] service_user.certfile = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] service_user.collect_timing = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] service_user.insecure = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] service_user.keyfile = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] service_user.send_service_user_token = True {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] service_user.split_loggers = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] service_user.timeout = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] glance.auth_section = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] glance.auth_type = password {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] glance.certfile = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] glance.collect_timing = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] glance.insecure = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] glance.keyfile = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] glance.region_name = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] glance.split_loggers = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] glance.timeout = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.backend_availability_zone = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.chap_password = **** {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.chap_username = {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.disk_geometry = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.driver_client_cert = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.driver_client_cert_key = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.driver_data_namespace = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.driver_use_ssl = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.extra_capabilities = {} {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.filter_function = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.goodness_function = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.iscsi_target_flags = {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.iscsi_write_cache = on {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.iser_helper = tgtadm {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.iser_ip_address = 192.168.122.11 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.iser_port = 3260 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.nas_host = {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.nas_login = admin {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.nas_mount_options = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.nas_password = **** {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.nas_private_key = {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.nas_share_path = {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.num_shell_tries = 3 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.quobyte_volume_url = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.replication_device = **** {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.report_discard_supported = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.reserved_percentage = 0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.target_helper = tgtadm {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.target_ip_address = 192.168.122.11 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.target_port = 3260 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.target_protocol = iscsi {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.trace_flags = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.unique_fqdn_network = True {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.use_chap_auth = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.volume_backend_name = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.volume_clear = zero {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.volume_clear_ionice = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.volume_clear_size = 0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_reports.file_event_handler = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_reports.log_dir = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.backend_availability_zone = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.backend_host = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.chap_password = **** {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.chap_username = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.chiscsi_conf = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack quobyte-client[82589]: Reading configuration file: /etc/quobyte/client.cfg Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.disk_geometry = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.driver_client_cert = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.driver_data_namespace = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.driver_use_ssl = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack quobyte-client[82589]: Invalid parameters found, error: missing mount point. Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.extra_capabilities = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.filter_function = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.goodness_function = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack quobyte-client[82589]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.iser_helper = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack quobyte-client[82589]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.iser_ip_address = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.iser_port = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.iser_target_prefix = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.nas_host = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.nas_login = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.nas_mount_options = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.nas_password = **** {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.nas_private_key = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.nas_share_path = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.nas_ssh_port = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.num_shell_tries = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.nvmet_port_id = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.replication_device = **** {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.report_discard_supported = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.reserved_percentage = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.scst_target_driver = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.storage_protocol = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.target_helper = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.target_ip_address = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.target_port = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.target_prefix = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.target_protocol = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.trace_flags = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.use_chap_auth = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.volume_clear = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.volume_clear_size = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] QuobyteHD.volumes_dir = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] CMD "mount.quobyte" returned: 1 in 0.134s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.ssl = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:39:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_notifications.driver = [] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_notifications.retry = -1 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack sudo[82615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] key_manager.fixed_key = **** {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] barbican.barbican_api_version = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack sudo[82615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] barbican.barbican_endpoint = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] barbican.barbican_endpoint_type = public {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] barbican.barbican_region_name = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] barbican.cafile = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] barbican.certfile = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] barbican.collect_timing = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] barbican.insecure = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] barbican.keyfile = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] barbican.number_of_retries = 60 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] barbican.retry_delay = 1 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] barbican.send_service_user_token = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] barbican.split_loggers = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] barbican.timeout = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:39:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] barbican.verify_ssl = True {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] barbican.verify_ssl_path = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] barbican_service_user.auth_section = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] barbican_service_user.auth_type = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] barbican_service_user.cafile = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] barbican_service_user.certfile = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] barbican_service_user.collect_timing = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] barbican_service_user.insecure = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] barbican_service_user.keyfile = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] barbican_service_user.split_loggers = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] barbican_service_user.timeout = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] vault.approle_role_id = **** {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] vault.approle_secret_id = **** {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] vault.kv_mountpoint = secret {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] vault.kv_path = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] vault.kv_version = 2 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] vault.namespace = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] vault.root_token_id = **** {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] vault.ssl_ca_crt_file = None {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] vault.timeout = 60.0 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] vault.use_ssl = False {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 19:39:39 devstack cinder-volume[82427]: DEBUG oslo_service.backend._eventlet.service [None req-d8849cb1-3f55-4bec-a8d1-fd082ef46483 None None] ******************************************************************************** {{(pid=82427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 16 19:39:40 devstack sudo[82615]: pam_unix(sudo:session): session closed for user root Apr 16 19:39:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.591s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:39:40 devstack cinder-volume[82569]: INFO cinder.volume.driver [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Driver hasn't implemented _init_vendor_properties() Apr 16 19:39:40 devstack cinder-volume[82569]: DEBUG cinder.volume.driver [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6951370239258, 'free_capacity_gb': 1775.6951370239258, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82569) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 16 19:39:40 devstack cinder-volume[82569]: DEBUG oslo_db.sqlalchemy.engines [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82569) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 19:39:40 devstack cinder-volume[82569]: DEBUG dbcounter [-] [82569] Writer thread running {{(pid=82569) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 19:39:40 devstack cinder-volume[82569]: DEBUG cinder.db.sqlalchemy.api [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Building query based on filter {{(pid=82569) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 16 19:39:40 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82569) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 16 19:39:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:39:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:39:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:39:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:39:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:39:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:39:40 devstack cinder-volume[82569]: INFO cinder.keymgr.migration [None req-e51f77c4-b299-4ebb-8818-a792c17e5d5a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 16 19:39:40 devstack sudo[82657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:39:40 devstack sudo[82657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:39:40 devstack sudo[82657]: pam_unix(sudo:session): session closed for user root Apr 16 19:39:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.413s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:39:40 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:39:40 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Driver initialization completed successfully. Apr 16 19:39:40 devstack cinder-volume[82569]: INFO cinder.manager [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Initiating service 3 cleanup Apr 16 19:39:40 devstack cinder-volume[82569]: INFO cinder.manager [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Service 3 cleanup completed. Apr 16 19:39:40 devstack cinder-volume[82569]: DEBUG cinder.service [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Creating RPC server for service cinder-volume {{(pid=82569) start /opt/stack/cinder/cinder/service.py:231}} Apr 16 19:39:40 devstack cinder-volume[82569]: DEBUG cinder.service [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82569) start /opt/stack/cinder/cinder/service.py:237}} Apr 16 19:39:40 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 16 19:39:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:39:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:39:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:39:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:39:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:39:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:39:40 devstack sudo[82672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:39:40 devstack sudo[82672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:39:41 devstack sudo[82672]: pam_unix(sudo:session): session closed for user root Apr 16 19:39:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.428s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:39:41 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-f5a03cbb-4d40-4bb9-9920-fb86417e39d1 None None] Driver post RPC initialization completed successfully. Apr 16 19:39:49 devstack cinder-volume[82427]: DEBUG dbcounter [-] [82427] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82427) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:39:50 devstack cinder-volume[82569]: DEBUG dbcounter [-] [82569] Writing DB stats cinder:SELECT=2 {{(pid=82569) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:39:51 devstack cinder-volume[82569]: DEBUG dbcounter [-] [82569] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82569) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Flow 'volume_create_manager' (52b970bd-a02c-4e7d-ba78-ffc1fae9ed8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbb7115-1798-45b3-808f-f300058fd3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbb7115-1798-45b3-808f-f300058fd3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:40:39Z,deleted=False,deleted_at=None,display_description='',display_name='824633ac-bee9-4f80-9f39-6eec57511ed6-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443b3a7a-1e66-4f90-918d-b2779486166b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f9b942d7554be7901b305e56f78572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:40:41Z,use_quota=True,user_id='a426989df2c24315bff842cff12285cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a11bdc1-30b0-4213-8a78-ecfbac85b874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a11bdc1-30b0-4213-8a78-ecfbac85b874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd36a2fd-a688-4820-910f-05820d357edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd36a2fd-a688-4820-910f-05820d357edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '443b3a7a-1e66-4f90-918d-b2779486166b', 'volume_name': 'volume-443b3a7a-1e66-4f90-918d-b2779486166b', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a0554d8-842a-4a5e-956f-3e343723ce83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a0554d8-842a-4a5e-956f-3e343723ce83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04198eb7-a6ef-4379-a5b9-e333d58139f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:40:41 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Volume 443b3a7a-1e66-4f90-918d-b2779486166b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-443b3a7a-1e66-4f90-918d-b2779486166b', 'volume_size': 1} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:40:39Z,deleted=False,deleted_at=None,display_description='',display_name='824633ac-bee9-4f80-9f39-6eec57511ed6-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443b3a7a-1e66-4f90-918d-b2779486166b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f9b942d7554be7901b305e56f78572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:40:41Z,use_quota=True,user_id='a426989df2c24315bff842cff12285cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Creating volume 443b3a7a-1e66-4f90-918d-b2779486166b {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:40:41 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-443b3a7a-1e66-4f90-918d-b2779486166b 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:40:41 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-3d05bbc8-6a56-4947-ac27-b53c6b3fe8d2 tempest-GroupSnapshotsTest-1945451735 None] Group tempest-GroupSnapshotsTest-Group-769579752: creating Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Flow 'volume_create_manager' (9fa8a72c-7ff2-4e31-9745-e882d8298cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df73c71-127a-47b8-be5f-54603c0661e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:40:41 devstack sudo[83154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-443b3a7a-1e66-4f90-918d-b2779486166b 1073741824 Apr 16 19:40:41 devstack sudo[83154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df73c71-127a-47b8-be5f-54603c0661e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1442555065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a58ca08a-8b13-4381-90c4-494691ee4bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf775b58a263414283b6daf79395ece4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:40:41Z,use_quota=True,user_id='9d488dc42f774881937740407ace2de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df3eab4-0e2a-43da-83fd-559524ce8943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df3eab4-0e2a-43da-83fd-559524ce8943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e207a3-3ce2-449f-9ea4-dc60f0101625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e207a3-3ce2-449f-9ea4-dc60f0101625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a58ca08a-8b13-4381-90c4-494691ee4bfb', 'volume_name': 'volume-a58ca08a-8b13-4381-90c4-494691ee4bfb', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9e7362-cee3-4f95-b0fd-23739f232879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9e7362-cee3-4f95-b0fd-23739f232879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7711e72a-7648-4b03-954c-f037324b0997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:40:41 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Volume a58ca08a-8b13-4381-90c4-494691ee4bfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a58ca08a-8b13-4381-90c4-494691ee4bfb', 'volume_size': 1} Apr 16 19:40:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:40:41 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-3d05bbc8-6a56-4947-ac27-b53c6b3fe8d2 tempest-GroupSnapshotsTest-1945451735 None] Group tempest-GroupSnapshotsTest-Group-769579752: created successfully Apr 16 19:40:41 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-3d05bbc8-6a56-4947-ac27-b53c6b3fe8d2 tempest-GroupSnapshotsTest-1945451735 None] Create group completed successfully. Apr 16 19:40:42 devstack sudo[83154]: pam_unix(sudo:session): session closed for user root Apr 16 19:40:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-443b3a7a-1e66-4f90-918d-b2779486166b 1073741824" returned: 0 in 1.543s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:40:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-443b3a7a-1e66-4f90-918d-b2779486166b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:40:43 devstack sudo[83481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-443b3a7a-1e66-4f90-918d-b2779486166b Apr 16 19:40:43 devstack sudo[83481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:40:43 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:40:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Flow 'volume_create_manager' (30038147-bbc3-4725-8917-44831d41d174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:40:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ddaac6-b4eb-46e9-8372-eec4125e7601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:40:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ddaac6-b4eb-46e9-8372-eec4125e7601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1622130462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=935893bf-2f1d-4c3e-9259-a64e3df40271,host='devstack@QuobyteHD#QuobyteHD',id=c36f883c-fad9-4849-89a1-6cc8e119ed07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1679651795415e8cf4fe10cf6caced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:40:43Z,use_quota=True,user_id='5459084109c14ccf990630df43e32d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b50b6336-21fb-4e8d-8966-220f98e82fd1),volume_type_id=b50b6336-21fb-4e8d-8966-220f98e82fd1)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:40:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16eb3a4c-dde6-4f8b-a273-663117544d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:40:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16eb3a4c-dde6-4f8b-a273-663117544d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:40:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609bf84a-b195-4d82-a303-abc98049628f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:40:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609bf84a-b195-4d82-a303-abc98049628f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c36f883c-fad9-4849-89a1-6cc8e119ed07', 'volume_name': 'volume-c36f883c-fad9-4849-89a1-6cc8e119ed07', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:40:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fee67a3-d9fd-421f-91a4-628984c2b342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:40:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fee67a3-d9fd-421f-91a4-628984c2b342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:40:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5580c828-b9db-465c-a3be-cce258aab632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:40:43 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Volume c36f883c-fad9-4849-89a1-6cc8e119ed07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c36f883c-fad9-4849-89a1-6cc8e119ed07', 'volume_size': 1} Apr 16 19:40:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:40:44 devstack sudo[83481]: pam_unix(sudo:session): session closed for user root Apr 16 19:40:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-443b3a7a-1e66-4f90-918d-b2779486166b" returned: 0 in 1.279s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:40:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] <== create_volume: return (2949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:40:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.951s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:40:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.835s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:40:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1442555065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a58ca08a-8b13-4381-90c4-494691ee4bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf775b58a263414283b6daf79395ece4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:40:41Z,use_quota=True,user_id='9d488dc42f774881937740407ace2de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:40:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Creating volume a58ca08a-8b13-4381-90c4-494691ee4bfb {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:40:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:40:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:40:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:40:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:40:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:40:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:40:44 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:40:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a58ca08a-8b13-4381-90c4-494691ee4bfb 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:40:44 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04198eb7-a6ef-4379-a5b9-e333d58139f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-443b3a7a-1e66-4f90-918d-b2779486166b', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:40:44 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16d3cfe-3df7-4ec8-8880-4bda538833c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:40:44 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Volume volume-443b3a7a-1e66-4f90-918d-b2779486166b (443b3a7a-1e66-4f90-918d-b2779486166b): created successfully Apr 16 19:40:44 devstack sudo[83500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a58ca08a-8b13-4381-90c4-494691ee4bfb 1073741824 Apr 16 19:40:44 devstack sudo[83500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:40:44 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16d3cfe-3df7-4ec8-8880-4bda538833c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:40:44 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Flow 'volume_create_manager' (52b970bd-a02c-4e7d-ba78-ffc1fae9ed8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:40:44 devstack cinder-volume[82569]: INFO cinder.volume.manager [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-066b54de-39f8-4e98-a9dd-0c3b17dba263 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Created volume successfully. Apr 16 19:40:45 devstack sudo[83500]: pam_unix(sudo:session): session closed for user root Apr 16 19:40:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a58ca08a-8b13-4381-90c4-494691ee4bfb 1073741824" returned: 0 in 0.863s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:40:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a58ca08a-8b13-4381-90c4-494691ee4bfb {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:40:45 devstack sudo[83505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a58ca08a-8b13-4381-90c4-494691ee4bfb Apr 16 19:40:45 devstack sudo[83505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:40:46 devstack sudo[83505]: pam_unix(sudo:session): session closed for user root Apr 16 19:40:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a58ca08a-8b13-4381-90c4-494691ee4bfb" returned: 0 in 0.804s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:40:46 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:40:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:40:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.604s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:40:46 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=935893bf-2f1d-4c3e-9259-a64e3df40271,created_at=2026-04-16T17:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1622130462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=935893bf-2f1d-4c3e-9259-a64e3df40271,host='devstack@QuobyteHD#QuobyteHD',id=c36f883c-fad9-4849-89a1-6cc8e119ed07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1679651795415e8cf4fe10cf6caced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:40:43Z,use_quota=True,user_id='5459084109c14ccf990630df43e32d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b50b6336-21fb-4e8d-8966-220f98e82fd1),volume_type_id=b50b6336-21fb-4e8d-8966-220f98e82fd1)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:40:46 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Creating volume c36f883c-fad9-4849-89a1-6cc8e119ed07 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:40:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:40:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:40:46 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:40:46 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:40:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:40:46 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:40:46 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:40:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:40:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7711e72a-7648-4b03-954c-f037324b0997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a58ca08a-8b13-4381-90c4-494691ee4bfb', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:40:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e79e51d-47a1-4752-bf46-21e13b1977a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:40:46 devstack sudo[83513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07 1073741824 Apr 16 19:40:46 devstack sudo[83513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:40:46 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Volume volume-a58ca08a-8b13-4381-90c4-494691ee4bfb (a58ca08a-8b13-4381-90c4-494691ee4bfb): created successfully Apr 16 19:40:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e79e51d-47a1-4752-bf46-21e13b1977a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:40:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Flow 'volume_create_manager' (9fa8a72c-7ff2-4e31-9745-e882d8298cd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:40:46 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-015767b8-1025-45c6-8396-90524a4b88a8 tempest-DeleteServersTestJSON-706253607 None] Created volume successfully. Apr 16 19:40:47 devstack sudo[83513]: pam_unix(sudo:session): session closed for user root Apr 16 19:40:47 devstack cinder-volume[82569]: WARNING py.warnings [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-0bfc947d-a0fe-4976-b2b1-bac1fd1e3035 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 16 19:40:47 devstack cinder-volume[82569]: .first() Apr 16 19:40:47 devstack cinder-volume[82569]: Apr 16 19:40:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07 1073741824" returned: 0 in 1.480s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:40:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-0bfc947d-a0fe-4976-b2b1-bac1fd1e3035 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:40:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:40:47 devstack sudo[83540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07 Apr 16 19:40:47 devstack sudo[83540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:40:48 devstack sudo[83540]: pam_unix(sudo:session): session closed for user root Apr 16 19:40:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07" returned: 0 in 0.645s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:40:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] <== create_volume: return (2186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:40:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.189s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:40:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-0bfc947d-a0fe-4976-b2b1-bac1fd1e3035 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.670s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:40:48 devstack cinder-volume[82569]: INFO oslo.privsep.daemon [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-0bfc947d-a0fe-4976-b2b1-bac1fd1e3035 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpxhdmp9rh/privsep.sock'] Apr 16 19:40:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5580c828-b9db-465c-a3be-cce258aab632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c36f883c-fad9-4849-89a1-6cc8e119ed07', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:40:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf0a803-5345-46e8-9779-99740e8eb248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:40:48 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Volume volume-c36f883c-fad9-4849-89a1-6cc8e119ed07 (c36f883c-fad9-4849-89a1-6cc8e119ed07): created successfully Apr 16 19:40:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf0a803-5345-46e8-9779-99740e8eb248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:40:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Flow 'volume_create_manager' (30038147-bbc3-4725-8917-44831d41d174) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:40:48 devstack sudo[83552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpxhdmp9rh/privsep.sock Apr 16 19:40:48 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-19a2f8eb-1956-4bdd-8611-a6a4101ff83e tempest-GroupSnapshotsTest-1945451735 None] Created volume successfully. Apr 16 19:40:48 devstack sudo[83552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:40:48 devstack cinder-volume[82569]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 16 19:40:48 devstack cinder-volume[82569]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 19:40:48 devstack cinder-volume[82569]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 16 19:40:48 devstack cinder-volume[82569]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 19:40:48 devstack cinder-volume[82569]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 16 19:40:48 devstack cinder-volume[82569]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 16 19:40:48 devstack cinder-volume[82569]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 19:40:48 devstack cinder-volume[82569]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 19:40:48 devstack cinder-volume[82569]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 16 19:40:49 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-1d747fb8-bc16-4e8a-963a-c6ff1835c7ed tempest-GroupSnapshotsTest-1945451735 None] GroupSnapshot 7a324c83-fa4e-45e8-8e95-cb41ed5f1ad4: creating. Apr 16 19:40:49 devstack cinder-volume[82569]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 16 19:40:49 devstack cinder-volume[82569]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 19:40:49 devstack cinder-volume[82569]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 16 19:40:49 devstack cinder-volume[82569]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 19:40:49 devstack cinder-volume[82569]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 16 19:40:49 devstack cinder-volume[82569]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 16 19:40:49 devstack cinder-volume[82569]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 19:40:49 devstack cinder-volume[82569]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 19:40:49 devstack cinder-volume[82569]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 16 19:40:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1d747fb8-bc16-4e8a-963a-c6ff1835c7ed tempest-GroupSnapshotsTest-1945451735 None] Group snapshot 7a324c83-fa4e-45e8-8e95-cb41ed5f1ad4: creating. {{(pid=82569) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 16 19:40:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1d747fb8-bc16-4e8a-963a-c6ff1835c7ed tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:40:50 devstack sudo[83552]: pam_unix(sudo:session): session closed for user root Apr 16 19:40:50 devstack cinder-volume[82569]: INFO oslo.privsep.daemon [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-0bfc947d-a0fe-4976-b2b1-bac1fd1e3035 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Spawned new privsep daemon via rootwrap Apr 16 19:40:50 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-0bfc947d-a0fe-4976-b2b1-bac1fd1e3035 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Accepted privsep connection to /tmp/tmpxhdmp9rh/privsep.sock {{(pid=82569) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 16 19:40:50 devstack cinder-volume[82569]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 16 19:40:50 devstack cinder-volume[82569]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 16 19:40:50 devstack cinder-volume[82569]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 16 19:40:50 devstack cinder-volume[82569]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83555 Apr 16 19:40:50 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[941aa7ec-9a95-4223-8ed4-87a983108f3e]: (2,) {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:40:50 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5c8fea-d91f-4812-afe3-40e7a67ed185]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:40:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-0bfc947d-a0fe-4976-b2b1-bac1fd1e3035 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-443b3a7a-1e66-4f90-918d-b2779486166b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:40:50 devstack sudo[83558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-443b3a7a-1e66-4f90-918d-b2779486166b Apr 16 19:40:50 devstack sudo[83558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:40:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-2b5bc2d2-e8cb-4401-8fec-e711f3f7b85c req-c54ca4a5-6eef-457c-809a-070a44a0a665 tempest-DeleteServersTestJSON-706253607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:40:51 devstack sudo[83558]: pam_unix(sudo:session): session closed for user root Apr 16 19:40:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-0bfc947d-a0fe-4976-b2b1-bac1fd1e3035 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-443b3a7a-1e66-4f90-918d-b2779486166b" returned: 0 in 1.242s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:40:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-0bfc947d-a0fe-4976-b2b1-bac1fd1e3035 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.557s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:40:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1d747fb8-bc16-4e8a-963a-c6ff1835c7ed tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.279s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:40:52 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-1d747fb8-bc16-4e8a-963a-c6ff1835c7ed tempest-GroupSnapshotsTest-1945451735 None] Creating offline snapshot 213f4b46-6edf-4003-8baf-91bcd844086f of volume c36f883c-fad9-4849-89a1-6cc8e119ed07 {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:40:52 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-0bfc947d-a0fe-4976-b2b1-bac1fd1e3035 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c', 'name': 'volume-443b3a7a-1e66-4f90-918d-b2779486166b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7fe8f1ed-082a-4bc6-8856-df6a10a9987b', 'enforce_multipath': True} {{(pid=82569) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 16 19:40:52 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[599b7455-5c2a-426a-a9d0-20cc332d46d2]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:40:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1d747fb8-bc16-4e8a-963a-c6ff1835c7ed tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:40:52 devstack cinder-volume[82569]: INFO cinder.volume.manager [req-ce7da267-d04b-4f0e-b8e1-785f6988f6b5 req-0bfc947d-a0fe-4976-b2b1-bac1fd1e3035 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] attachment_update completed successfully. Apr 16 19:40:52 devstack sudo[83578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07 Apr 16 19:40:52 devstack sudo[83578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:40:53 devstack sudo[83578]: pam_unix(sudo:session): session closed for user root Apr 16 19:40:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1d747fb8-bc16-4e8a-963a-c6ff1835c7ed tempest-GroupSnapshotsTest-1945451735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07" returned: 0 in 0.972s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:40:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1d747fb8-bc16-4e8a-963a-c6ff1835c7ed tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.213f4b46-6edf-4003-8baf-91bcd844086f 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:40:53 devstack sudo[83583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.213f4b46-6edf-4003-8baf-91bcd844086f 1G Apr 16 19:40:53 devstack sudo[83583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:40:54 devstack sudo[83583]: pam_unix(sudo:session): session closed for user root Apr 16 19:40:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1d747fb8-bc16-4e8a-963a-c6ff1835c7ed tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.213f4b46-6edf-4003-8baf-91bcd844086f 1G" returned: 0 in 0.838s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:40:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1d747fb8-bc16-4e8a-963a-c6ff1835c7ed tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c36f883c-fad9-4849-89a1-6cc8e119ed07 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.213f4b46-6edf-4003-8baf-91bcd844086f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:40:54 devstack sudo[83589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c36f883c-fad9-4849-89a1-6cc8e119ed07 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.213f4b46-6edf-4003-8baf-91bcd844086f Apr 16 19:40:54 devstack sudo[83589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:40:54 devstack sudo[83589]: pam_unix(sudo:session): session closed for user root Apr 16 19:40:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1d747fb8-bc16-4e8a-963a-c6ff1835c7ed tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c36f883c-fad9-4849-89a1-6cc8e119ed07 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.213f4b46-6edf-4003-8baf-91bcd844086f" returned: 0 in 0.760s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:40:54 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-1d747fb8-bc16-4e8a-963a-c6ff1835c7ed tempest-GroupSnapshotsTest-1945451735 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.213f4b46-6edf-4003-8baf-91bcd844086f is being set with open permissions: ugo+rw: NotImplementedError Apr 16 19:40:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1d747fb8-bc16-4e8a-963a-c6ff1835c7ed tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.213f4b46-6edf-4003-8baf-91bcd844086f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:40:54 devstack sudo[83617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.213f4b46-6edf-4003-8baf-91bcd844086f Apr 16 19:40:54 devstack sudo[83617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:40:55 devstack sudo[83617]: pam_unix(sudo:session): session closed for user root Apr 16 19:40:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1d747fb8-bc16-4e8a-963a-c6ff1835c7ed tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.213f4b46-6edf-4003-8baf-91bcd844086f" returned: 0 in 0.484s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:40:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1d747fb8-bc16-4e8a-963a-c6ff1835c7ed tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:40:55 devstack sudo[83665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.info Apr 16 19:40:55 devstack sudo[83665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:40:55 devstack sudo[83665]: pam_unix(sudo:session): session closed for user root Apr 16 19:40:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1d747fb8-bc16-4e8a-963a-c6ff1835c7ed tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.info" returned: 0 in 0.698s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:40:56 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-1d747fb8-bc16-4e8a-963a-c6ff1835c7ed tempest-GroupSnapshotsTest-1945451735 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 19:40:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1d747fb8-bc16-4e8a-963a-c6ff1835c7ed tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:40:56 devstack sudo[83668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.info Apr 16 19:40:56 devstack sudo[83668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:40:56 devstack sudo[83668]: pam_unix(sudo:session): session closed for user root Apr 16 19:40:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1d747fb8-bc16-4e8a-963a-c6ff1835c7ed tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.info" returned: 0 in 0.737s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:40:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1d747fb8-bc16-4e8a-963a-c6ff1835c7ed tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.793s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:40:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-2b5bc2d2-e8cb-4401-8fec-e711f3f7b85c req-c54ca4a5-6eef-457c-809a-070a44a0a665 tempest-DeleteServersTestJSON-706253607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.210s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:40:56 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74c110f-c4c5-4a15-922d-c7f8214226b6]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:40:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-2b5bc2d2-e8cb-4401-8fec-e711f3f7b85c req-c54ca4a5-6eef-457c-809a-070a44a0a665 tempest-DeleteServersTestJSON-706253607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a58ca08a-8b13-4381-90c4-494691ee4bfb {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:40:56 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-1d747fb8-bc16-4e8a-963a-c6ff1835c7ed tempest-GroupSnapshotsTest-1945451735 None] group_snapshot 7a324c83-fa4e-45e8-8e95-cb41ed5f1ad4: created successfully Apr 16 19:40:56 devstack sudo[83674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a58ca08a-8b13-4381-90c4-494691ee4bfb Apr 16 19:40:56 devstack sudo[83674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:40:57 devstack sudo[83674]: pam_unix(sudo:session): session closed for user root Apr 16 19:40:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-2b5bc2d2-e8cb-4401-8fec-e711f3f7b85c req-c54ca4a5-6eef-457c-809a-070a44a0a665 tempest-DeleteServersTestJSON-706253607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a58ca08a-8b13-4381-90c4-494691ee4bfb" returned: 0 in 0.694s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:40:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-2b5bc2d2-e8cb-4401-8fec-e711f3f7b85c req-c54ca4a5-6eef-457c-809a-070a44a0a665 tempest-DeleteServersTestJSON-706253607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.709s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:40:57 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-2b5bc2d2-e8cb-4401-8fec-e711f3f7b85c req-c54ca4a5-6eef-457c-809a-070a44a0a665 tempest-DeleteServersTestJSON-706253607 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c', 'name': 'volume-a58ca08a-8b13-4381-90c4-494691ee4bfb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a1d54e80-8f8f-4837-93df-eb981637d294', 'enforce_multipath': True} {{(pid=82569) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 16 19:40:57 devstack cinder-volume[82569]: INFO cinder.volume.manager [req-2b5bc2d2-e8cb-4401-8fec-e711f3f7b85c req-c54ca4a5-6eef-457c-809a-070a44a0a665 tempest-DeleteServersTestJSON-706253607 None] attachment_update completed successfully. Apr 16 19:40:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:40:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:40:58 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "cinder-quobyte-213f4b46-6edf-4003-8baf-91bcd844086f-bd60454b-fea5-44ec-bc27-e1c68405ecf5" by "_create_volume_from_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:40:58 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-213f4b46-6edf-4003-8baf-91bcd844086f-bd60454b-fea5-44ec-bc27-e1c68405ecf5" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:40:58 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Creating volume bd60454b-fea5-44ec-bc27-e1c68405ecf5 from snapshot 213f4b46-6edf-4003-8baf-91bcd844086f {{(pid=82569) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 19:40:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:40:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:40:58 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:40:58 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:40:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:40:58 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:40:58 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "cinder-quobyte-bd60454b-fea5-44ec-bc27-e1c68405ecf5" by "_copy_volume_from_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:40:58 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-bd60454b-fea5-44ec-bc27-e1c68405ecf5" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:40:58 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] snapshot: 213f4b46-6edf-4003-8baf-91bcd844086f, volume: bd60454b-fea5-44ec-bc27-e1c68405ecf5, {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 19:40:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:40:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:40:58 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:40:58 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:40:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:40:58 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2881e61-a6b5-47d5-ab25-54c6b4947243]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:40:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.213f4b46-6edf-4003-8baf-91bcd844086f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:40:59 devstack sudo[84022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.213f4b46-6edf-4003-8baf-91bcd844086f Apr 16 19:40:59 devstack sudo[84022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:40:59 devstack sudo[84022]: pam_unix(sudo:session): session closed for user root Apr 16 19:40:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.213f4b46-6edf-4003-8baf-91bcd844086f" returned: 0 in 0.955s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:40:59 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c36f883c-fad9-4849-89a1-6cc8e119ed07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:40:59 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07 {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 19:40:59 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Creating direct copy from snapshot {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 19:40:59 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d4c412-a3b8-49f6-b210-817b40d62d5f]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:40:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:00 devstack sudo[84034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07 Apr 16 19:41:00 devstack sudo[84034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:00 devstack sudo[84034]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07" returned: 0 in 0.614s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:00 devstack cinder-volume[82569]: DEBUG cinder.utils [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Path /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-bd60454b-fea5-44ec-bc27-e1c68405ecf5 not found in is_blk_device check {{(pid=82569) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 19:41:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-bd60454b-fea5-44ec-bc27-e1c68405ecf5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:00 devstack sudo[84040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-bd60454b-fea5-44ec-bc27-e1c68405ecf5 Apr 16 19:41:00 devstack sudo[84040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:03 devstack sudo[84040]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-bd60454b-fea5-44ec-bc27-e1c68405ecf5" returned: 0 in 3.175s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:03 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fae774-6d73-4c68-9ca2-d794891f90d3]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:41:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:03 devstack sudo[84092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07 Apr 16 19:41:03 devstack sudo[84092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:04 devstack cinder-volume[82569]: DEBUG oslo_service.periodic_task [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82569) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 19:41:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:41:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:41:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:41:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:41:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:41:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:04 devstack sudo[84095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:41:04 devstack sudo[84095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:04 devstack sudo[84092]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07" returned: 0 in 0.917s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:04 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Image conversion details: src /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07, size 1024.00 MB, duration 3.18 sec, destination /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-bd60454b-fea5-44ec-bc27-e1c68405ecf5 {{(pid=82569) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 19:41:04 devstack cinder-volume[82569]: INFO cinder.image.image_utils [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Converted 1024.00 MB image at 322.40 MB/s Apr 16 19:41:04 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-bd60454b-fea5-44ec-bc27-e1c68405ecf5 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 19:41:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-bd60454b-fea5-44ec-bc27-e1c68405ecf5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:04 devstack sudo[84104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-bd60454b-fea5-44ec-bc27-e1c68405ecf5 Apr 16 19:41:04 devstack sudo[84104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:04 devstack sudo[84095]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.731s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:04 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:41:05 devstack sudo[84104]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-bd60454b-fea5-44ec-bc27-e1c68405ecf5" returned: 0 in 0.531s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:05 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-bd60454b-fea5-44ec-bc27-e1c68405ecf5" released by "_copy_volume_from_snapshot" :: held 6.426s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:41:05 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-213f4b46-6edf-4003-8baf-91bcd844086f-bd60454b-fea5-44ec-bc27-e1c68405ecf5" released by "_create_volume_from_snapshot" :: held 6.489s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:41:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.501s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:41:05 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-d57c373e-15be-4ba8-af9b-c092aec3db6b tempest-GroupSnapshotsTest-1945451735 None] Create group from source-snapshot-7a324c83-fa4e-45e8-8e95-cb41ed5f1ad4 completed successfully. Apr 16 19:41:06 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-df7f5a39-cb43-4a0e-84d6-0fc0094357f1 tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "cinder-quobyte-bd60454b-fea5-44ec-bc27-e1c68405ecf5" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:41:06 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-df7f5a39-cb43-4a0e-84d6-0fc0094357f1 tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-bd60454b-fea5-44ec-bc27-e1c68405ecf5" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:41:06 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[54579822-9255-4461-82e1-12a895960477]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:41:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-df7f5a39-cb43-4a0e-84d6-0fc0094357f1 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-bd60454b-fea5-44ec-bc27-e1c68405ecf5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:06 devstack sudo[84108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-bd60454b-fea5-44ec-bc27-e1c68405ecf5 Apr 16 19:41:06 devstack sudo[84108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:07 devstack sudo[84108]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-df7f5a39-cb43-4a0e-84d6-0fc0094357f1 tempest-GroupSnapshotsTest-1945451735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-bd60454b-fea5-44ec-bc27-e1c68405ecf5" returned: 0 in 0.807s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-df7f5a39-cb43-4a0e-84d6-0fc0094357f1 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-bd60454b-fea5-44ec-bc27-e1c68405ecf5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:07 devstack sudo[84118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-bd60454b-fea5-44ec-bc27-e1c68405ecf5 Apr 16 19:41:07 devstack sudo[84118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:07 devstack sudo[84118]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-df7f5a39-cb43-4a0e-84d6-0fc0094357f1 tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-bd60454b-fea5-44ec-bc27-e1c68405ecf5" returned: 0 in 0.663s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:07 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-df7f5a39-cb43-4a0e-84d6-0fc0094357f1 tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-bd60454b-fea5-44ec-bc27-e1c68405ecf5" released by "delete_volume" :: held 1.505s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:41:07 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-df7f5a39-cb43-4a0e-84d6-0fc0094357f1 tempest-GroupSnapshotsTest-1945451735 None] Created reservations ['e2e85430-a6ce-4bff-a53d-8df569048f8b'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:41:07 devstack cinder-volume[82569]: WARNING cinder.quota [None req-df7f5a39-cb43-4a0e-84d6-0fc0094357f1 tempest-GroupSnapshotsTest-1945451735 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1417710157 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1417710157, it is now deprecated. Please use the default quota class for default quota. Apr 16 19:41:07 devstack cinder-volume[82569]: WARNING cinder.quota [None req-df7f5a39-cb43-4a0e-84d6-0fc0094357f1 tempest-GroupSnapshotsTest-1945451735 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1417710157 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1417710157, it is now deprecated. Please use the default quota class for default quota. Apr 16 19:41:07 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-df7f5a39-cb43-4a0e-84d6-0fc0094357f1 tempest-GroupSnapshotsTest-1945451735 None] Created reservations ['3bfc83ec-2cf4-4131-abec-05caa3fc18bb', 'ceb46b3f-52bb-4cef-a6b7-754149274d80', '28ec29fe-03e5-482c-9521-0d09927ff649', '0ab08ee6-bfbf-479d-9e29-fea7ae1f2d42'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:41:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-df7f5a39-cb43-4a0e-84d6-0fc0094357f1 tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:41:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-df7f5a39-cb43-4a0e-84d6-0fc0094357f1 tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:41:07 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-df7f5a39-cb43-4a0e-84d6-0fc0094357f1 tempest-GroupSnapshotsTest-1945451735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:41:07 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-df7f5a39-cb43-4a0e-84d6-0fc0094357f1 tempest-GroupSnapshotsTest-1945451735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:41:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-df7f5a39-cb43-4a0e-84d6-0fc0094357f1 tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:41:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-df7f5a39-cb43-4a0e-84d6-0fc0094357f1 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:08 devstack sudo[84124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:41:08 devstack sudo[84124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:08 devstack cinder-volume[82569]: INFO cinder.volume.manager [req-22d80178-9734-4260-a68b-1d3f70c18303 req-fce42dd3-41cd-45a7-9375-e8d1ddbf6637 tempest-DeleteServersTestJSON-706253607 None] Terminate volume connection completed successfully. Apr 16 19:41:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-22d80178-9734-4260-a68b-1d3f70c18303 req-fce42dd3-41cd-45a7-9375-e8d1ddbf6637 tempest-DeleteServersTestJSON-706253607 None] Deleting attachment a1d54e80-8f8f-4837-93df-eb981637d294. {{(pid=82569) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 16 19:41:08 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-2fe3b527-4757-47e4-882d-a2311c61fb4b tempest-GroupSnapshotsTest-1945451735 None] group_snapshot 7a324c83-fa4e-45e8-8e95-cb41ed5f1ad4: deleting Apr 16 19:41:08 devstack sudo[84124]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-df7f5a39-cb43-4a0e-84d6-0fc0094357f1 tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.608s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:08 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-df7f5a39-cb43-4a0e-84d6-0fc0094357f1 tempest-GroupSnapshotsTest-1945451735 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:41:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2fe3b527-4757-47e4-882d-a2311c61fb4b tempest-GroupSnapshotsTest-1945451735 None] group_snapshot 7a324c83-fa4e-45e8-8e95-cb41ed5f1ad4: deleting {{(pid=82569) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 16 19:41:08 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-df7f5a39-cb43-4a0e-84d6-0fc0094357f1 tempest-GroupSnapshotsTest-1945451735 None] Delete group completed successfully. Apr 16 19:41:08 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-2fe3b527-4757-47e4-882d-a2311c61fb4b tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "cinder-quobyte-c36f883c-fad9-4849-89a1-6cc8e119ed07" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:41:08 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-2fe3b527-4757-47e4-882d-a2311c61fb4b tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-c36f883c-fad9-4849-89a1-6cc8e119ed07" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:41:08 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-2fe3b527-4757-47e4-882d-a2311c61fb4b tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "cinder-quobyte-213f4b46-6edf-4003-8baf-91bcd844086f" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:41:08 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-2fe3b527-4757-47e4-882d-a2311c61fb4b tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-213f4b46-6edf-4003-8baf-91bcd844086f" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:41:08 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-2fe3b527-4757-47e4-882d-a2311c61fb4b tempest-GroupSnapshotsTest-1945451735 None] Deleting offline snapshot 213f4b46-6edf-4003-8baf-91bcd844086f of volume c36f883c-fad9-4849-89a1-6cc8e119ed07 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:41:08 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-2fe3b527-4757-47e4-882d-a2311c61fb4b tempest-GroupSnapshotsTest-1945451735 None] snapshot_file for this snap is: volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.213f4b46-6edf-4003-8baf-91bcd844086f {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:41:08 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[4452c750-4487-433f-966b-d5fa4936832c]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:41:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2fe3b527-4757-47e4-882d-a2311c61fb4b tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.213f4b46-6edf-4003-8baf-91bcd844086f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:08 devstack sudo[84151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.213f4b46-6edf-4003-8baf-91bcd844086f Apr 16 19:41:08 devstack sudo[84151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:09 devstack sudo[84151]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2fe3b527-4757-47e4-882d-a2311c61fb4b tempest-GroupSnapshotsTest-1945451735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.213f4b46-6edf-4003-8baf-91bcd844086f" returned: 0 in 0.512s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:09 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-2fe3b527-4757-47e4-882d-a2311c61fb4b tempest-GroupSnapshotsTest-1945451735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c36f883c-fad9-4849-89a1-6cc8e119ed07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:41:09 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3139eb-2bac-476d-9f56-dc31dd17c112]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:41:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2fe3b527-4757-47e4-882d-a2311c61fb4b tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:09 devstack sudo[84158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07 Apr 16 19:41:09 devstack sudo[84158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:09 devstack sudo[84158]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2fe3b527-4757-47e4-882d-a2311c61fb4b tempest-GroupSnapshotsTest-1945451735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07" returned: 0 in 0.595s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2fe3b527-4757-47e4-882d-a2311c61fb4b tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.213f4b46-6edf-4003-8baf-91bcd844086f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:09 devstack sudo[84207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.213f4b46-6edf-4003-8baf-91bcd844086f Apr 16 19:41:09 devstack sudo[84207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:10 devstack sudo[84207]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2fe3b527-4757-47e4-882d-a2311c61fb4b tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.213f4b46-6edf-4003-8baf-91bcd844086f" returned: 0 in 0.455s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2fe3b527-4757-47e4-882d-a2311c61fb4b tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.213f4b46-6edf-4003-8baf-91bcd844086f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:10 devstack sudo[84221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.213f4b46-6edf-4003-8baf-91bcd844086f Apr 16 19:41:10 devstack sudo[84221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:10 devstack sudo[84221]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2fe3b527-4757-47e4-882d-a2311c61fb4b tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07.213f4b46-6edf-4003-8baf-91bcd844086f" returned: 0 in 0.451s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:10 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-2fe3b527-4757-47e4-882d-a2311c61fb4b tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-213f4b46-6edf-4003-8baf-91bcd844086f" released by "_delete_snapshot" :: held 2.073s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:41:10 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-2fe3b527-4757-47e4-882d-a2311c61fb4b tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-c36f883c-fad9-4849-89a1-6cc8e119ed07" released by "delete_snapshot" :: held 2.089s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:41:10 devstack cinder-volume[82569]: WARNING cinder.quota [None req-2fe3b527-4757-47e4-882d-a2311c61fb4b tempest-GroupSnapshotsTest-1945451735 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1417710157 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1417710157, it is now deprecated. Please use the default quota class for default quota. Apr 16 19:41:10 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-2fe3b527-4757-47e4-882d-a2311c61fb4b tempest-GroupSnapshotsTest-1945451735 None] Created reservations ['1621411b-0b68-4a14-b201-5975fc1d596d', '157bfdbf-29a7-4b66-8c50-b8af127b9cbc', '66b26d74-c32b-413b-8c07-dbdb17d21ca3', '8627865b-233f-451d-b9cf-67591a3f5ad0'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:41:10 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-2fe3b527-4757-47e4-882d-a2311c61fb4b tempest-GroupSnapshotsTest-1945451735 None] group_snapshot 7a324c83-fa4e-45e8-8e95-cb41ed5f1ad4: deleted successfully Apr 16 19:41:12 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c2c055d4-b1ce-4484-b200-1a85ad0cec0d tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "cinder-quobyte-c36f883c-fad9-4849-89a1-6cc8e119ed07" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:41:12 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c2c055d4-b1ce-4484-b200-1a85ad0cec0d tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-c36f883c-fad9-4849-89a1-6cc8e119ed07" acquired by "delete_volume" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:41:12 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[795a9d3a-f973-4549-b5db-2a4b39a7fb87]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:41:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c2c055d4-b1ce-4484-b200-1a85ad0cec0d tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:12 devstack sudo[84225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07 Apr 16 19:41:12 devstack sudo[84225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:12 devstack sudo[84225]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c2c055d4-b1ce-4484-b200-1a85ad0cec0d tempest-GroupSnapshotsTest-1945451735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07" returned: 0 in 0.721s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c2c055d4-b1ce-4484-b200-1a85ad0cec0d tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:12 devstack sudo[84233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07 Apr 16 19:41:12 devstack sudo[84233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:13 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1a2b9c9d-9dc2-4e0e-813b-f4d5ec339c4d tempest-DeleteServersTestJSON-706253607 None] Acquiring lock "cinder-a58ca08a-8b13-4381-90c4-494691ee4bfb-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:41:13 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1a2b9c9d-9dc2-4e0e-813b-f4d5ec339c4d tempest-DeleteServersTestJSON-706253607 None] Lock "cinder-a58ca08a-8b13-4381-90c4-494691ee4bfb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:41:13 devstack sudo[84233]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:13 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1a2b9c9d-9dc2-4e0e-813b-f4d5ec339c4d tempest-DeleteServersTestJSON-706253607 None] Acquiring lock "cinder-quobyte-a58ca08a-8b13-4381-90c4-494691ee4bfb" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:41:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c2c055d4-b1ce-4484-b200-1a85ad0cec0d tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c36f883c-fad9-4849-89a1-6cc8e119ed07" returned: 0 in 0.527s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:13 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1a2b9c9d-9dc2-4e0e-813b-f4d5ec339c4d tempest-DeleteServersTestJSON-706253607 None] Lock "cinder-quobyte-a58ca08a-8b13-4381-90c4-494691ee4bfb" acquired by "delete_volume" :: waited 0.018s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:41:13 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c2c055d4-b1ce-4484-b200-1a85ad0cec0d tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-c36f883c-fad9-4849-89a1-6cc8e119ed07" released by "delete_volume" :: held 1.293s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:41:13 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[425b1a7b-2383-4197-9d91-e7d8ac8dcb80]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:41:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1a2b9c9d-9dc2-4e0e-813b-f4d5ec339c4d tempest-DeleteServersTestJSON-706253607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a58ca08a-8b13-4381-90c4-494691ee4bfb {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:13 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-c2c055d4-b1ce-4484-b200-1a85ad0cec0d tempest-GroupSnapshotsTest-1945451735 None] Created reservations ['c491bfc7-2612-456c-b4e4-af5633578d0d'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:41:13 devstack sudo[84241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a58ca08a-8b13-4381-90c4-494691ee4bfb Apr 16 19:41:13 devstack sudo[84241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:13 devstack cinder-volume[82569]: WARNING cinder.db.sqlalchemy.api [None req-c2c055d4-b1ce-4484-b200-1a85ad0cec0d tempest-GroupSnapshotsTest-1945451735 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1417710157'] Apr 16 19:41:13 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-c2c055d4-b1ce-4484-b200-1a85ad0cec0d tempest-GroupSnapshotsTest-1945451735 None] Created reservations ['188b55be-3e2e-40ce-8ae3-819d99714c7f', '6fa8271f-0c46-46ca-a375-4512451dfa1e', 'c73afc20-a992-4fca-91d3-c4f501efe0e9', 'f80e3bd7-cf4d-4daa-8408-aa6261d68ebf'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:41:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-c2c055d4-b1ce-4484-b200-1a85ad0cec0d tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:41:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-c2c055d4-b1ce-4484-b200-1a85ad0cec0d tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:41:13 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-c2c055d4-b1ce-4484-b200-1a85ad0cec0d tempest-GroupSnapshotsTest-1945451735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:41:13 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-c2c055d4-b1ce-4484-b200-1a85ad0cec0d tempest-GroupSnapshotsTest-1945451735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:41:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-c2c055d4-b1ce-4484-b200-1a85ad0cec0d tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:41:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c2c055d4-b1ce-4484-b200-1a85ad0cec0d tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:13 devstack sudo[84252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:41:13 devstack sudo[84252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:14 devstack sudo[84241]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1a2b9c9d-9dc2-4e0e-813b-f4d5ec339c4d tempest-DeleteServersTestJSON-706253607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a58ca08a-8b13-4381-90c4-494691ee4bfb" returned: 0 in 0.656s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1a2b9c9d-9dc2-4e0e-813b-f4d5ec339c4d tempest-DeleteServersTestJSON-706253607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a58ca08a-8b13-4381-90c4-494691ee4bfb {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:14 devstack sudo[84259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a58ca08a-8b13-4381-90c4-494691ee4bfb Apr 16 19:41:14 devstack sudo[84259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:14 devstack sudo[84252]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c2c055d4-b1ce-4484-b200-1a85ad0cec0d tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.628s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:14 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-c2c055d4-b1ce-4484-b200-1a85ad0cec0d tempest-GroupSnapshotsTest-1945451735 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:41:14 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-c2c055d4-b1ce-4484-b200-1a85ad0cec0d tempest-GroupSnapshotsTest-1945451735 None] Delete group completed successfully. Apr 16 19:41:14 devstack sudo[84259]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1a2b9c9d-9dc2-4e0e-813b-f4d5ec339c4d tempest-DeleteServersTestJSON-706253607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a58ca08a-8b13-4381-90c4-494691ee4bfb" returned: 0 in 0.578s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:14 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1a2b9c9d-9dc2-4e0e-813b-f4d5ec339c4d tempest-DeleteServersTestJSON-706253607 None] Lock "cinder-quobyte-a58ca08a-8b13-4381-90c4-494691ee4bfb" released by "delete_volume" :: held 1.258s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:41:14 devstack cinder-volume[82569]: WARNING cinder.quota [None req-1a2b9c9d-9dc2-4e0e-813b-f4d5ec339c4d tempest-DeleteServersTestJSON-706253607 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 16 19:41:14 devstack cinder-volume[82569]: WARNING cinder.quota [None req-1a2b9c9d-9dc2-4e0e-813b-f4d5ec339c4d tempest-DeleteServersTestJSON-706253607 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 16 19:41:14 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-1a2b9c9d-9dc2-4e0e-813b-f4d5ec339c4d tempest-DeleteServersTestJSON-706253607 None] Created reservations ['876dcb3a-1875-47fa-992d-485c1f06403e', '2c811a87-e87e-43f7-9f79-4c7f62887d21', 'f40ae38f-5a69-4cf8-badb-bd60a1d0b00e', 'b348a7b4-032f-4873-9cad-8f55a8bd8832'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:41:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1a2b9c9d-9dc2-4e0e-813b-f4d5ec339c4d tempest-DeleteServersTestJSON-706253607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:41:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1a2b9c9d-9dc2-4e0e-813b-f4d5ec339c4d tempest-DeleteServersTestJSON-706253607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:41:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1a2b9c9d-9dc2-4e0e-813b-f4d5ec339c4d tempest-DeleteServersTestJSON-706253607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:41:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1a2b9c9d-9dc2-4e0e-813b-f4d5ec339c4d tempest-DeleteServersTestJSON-706253607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:41:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1a2b9c9d-9dc2-4e0e-813b-f4d5ec339c4d tempest-DeleteServersTestJSON-706253607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:41:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1a2b9c9d-9dc2-4e0e-813b-f4d5ec339c4d tempest-DeleteServersTestJSON-706253607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:14 devstack sudo[84294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:41:14 devstack sudo[84294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:14 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-e956fcbd-6d5b-4f5a-b09e-b3961f5437c2 tempest-GroupSnapshotsTest-1945451735 None] Group tempest-GroupSnapshotsTest-Group-1288541743: creating Apr 16 19:41:14 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-e956fcbd-6d5b-4f5a-b09e-b3961f5437c2 tempest-GroupSnapshotsTest-1945451735 None] Group tempest-GroupSnapshotsTest-Group-1288541743: created successfully Apr 16 19:41:14 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-e956fcbd-6d5b-4f5a-b09e-b3961f5437c2 tempest-GroupSnapshotsTest-1945451735 None] Create group completed successfully. Apr 16 19:41:15 devstack sudo[84294]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1a2b9c9d-9dc2-4e0e-813b-f4d5ec339c4d tempest-DeleteServersTestJSON-706253607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.719s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:15 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-1a2b9c9d-9dc2-4e0e-813b-f4d5ec339c4d tempest-DeleteServersTestJSON-706253607 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:41:15 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-1a2b9c9d-9dc2-4e0e-813b-f4d5ec339c4d tempest-DeleteServersTestJSON-706253607 None] Deleted volume successfully. Apr 16 19:41:15 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1a2b9c9d-9dc2-4e0e-813b-f4d5ec339c4d tempest-DeleteServersTestJSON-706253607 None] Lock "cinder-a58ca08a-8b13-4381-90c4-494691ee4bfb-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:41:16 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:41:16 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Flow 'volume_create_manager' (05ef5ea7-d9b5-4f19-a9bf-5910e99840a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:41:16 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6ccfad-466f-4f41-8f47-142185cb6baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:16 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6ccfad-466f-4f41-8f47-142185cb6baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1857891246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fcdb4be3-977c-450d-9edb-5b4937c84763,host='devstack@QuobyteHD#QuobyteHD',id=4b32709f-341d-411c-a100-8844483d018c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1679651795415e8cf4fe10cf6caced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:41:16Z,use_quota=True,user_id='5459084109c14ccf990630df43e32d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8196e46-5472-454c-9041-6d2bb1f98933),volume_type_id=e8196e46-5472-454c-9041-6d2bb1f98933)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:16 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f035657-a80e-47d7-87ac-a3cad741bab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:16 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f035657-a80e-47d7-87ac-a3cad741bab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:16 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8fe9b2-ff20-41a4-ba01-fce748d64f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:16 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8fe9b2-ff20-41a4-ba01-fce748d64f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b32709f-341d-411c-a100-8844483d018c', 'volume_name': 'volume-4b32709f-341d-411c-a100-8844483d018c', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:16 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1678423-3c21-4cdd-84f2-e887e04d41c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:16 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1678423-3c21-4cdd-84f2-e887e04d41c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:16 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de36f44-9e93-4719-a598-ed34c745e26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:16 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Volume 4b32709f-341d-411c-a100-8844483d018c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b32709f-341d-411c-a100-8844483d018c', 'volume_size': 1} Apr 16 19:41:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:41:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:41:16 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fcdb4be3-977c-450d-9edb-5b4937c84763,created_at=2026-04-16T17:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1857891246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fcdb4be3-977c-450d-9edb-5b4937c84763,host='devstack@QuobyteHD#QuobyteHD',id=4b32709f-341d-411c-a100-8844483d018c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1679651795415e8cf4fe10cf6caced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:41:16Z,use_quota=True,user_id='5459084109c14ccf990630df43e32d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8196e46-5472-454c-9041-6d2bb1f98933),volume_type_id=e8196e46-5472-454c-9041-6d2bb1f98933)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:41:16 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Creating volume 4b32709f-341d-411c-a100-8844483d018c {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:41:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:41:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:41:16 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:41:16 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:41:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:41:16 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:41:16 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:41:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:16 devstack sudo[84327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c 1073741824 Apr 16 19:41:16 devstack sudo[84327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:17 devstack sudo[84327]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c 1073741824" returned: 0 in 0.604s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:17 devstack sudo[84334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c Apr 16 19:41:17 devstack sudo[84334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:17 devstack sudo[84334]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c" returned: 0 in 0.524s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:17 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:41:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:41:17 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de36f44-9e93-4719-a598-ed34c745e26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b32709f-341d-411c-a100-8844483d018c', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:17 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397ffd4e-d1f0-4ca3-aac2-fd055eabf9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:17 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Volume volume-4b32709f-341d-411c-a100-8844483d018c (4b32709f-341d-411c-a100-8844483d018c): created successfully Apr 16 19:41:17 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397ffd4e-d1f0-4ca3-aac2-fd055eabf9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:17 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Flow 'volume_create_manager' (05ef5ea7-d9b5-4f19-a9bf-5910e99840a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:41:17 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-f6d420a8-f8be-4157-93e0-2487033876b5 tempest-GroupSnapshotsTest-1945451735 None] Created volume successfully. Apr 16 19:41:19 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:41:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Flow 'volume_create_manager' (21f5da14-2c14-461d-8479-3945db876a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:41:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97d4967f-7327-474d-9a66-448883a5fe2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97d4967f-7327-474d-9a66-448883a5fe2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1300499444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fcdb4be3-977c-450d-9edb-5b4937c84763,host='devstack@QuobyteHD#QuobyteHD',id=d1fe8745-533e-40a5-b301-ffca67596a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1679651795415e8cf4fe10cf6caced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:41:19Z,use_quota=True,user_id='5459084109c14ccf990630df43e32d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8196e46-5472-454c-9041-6d2bb1f98933),volume_type_id=e8196e46-5472-454c-9041-6d2bb1f98933)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (365e012e-8e4e-40af-b1b4-cb5feaf28cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (365e012e-8e4e-40af-b1b4-cb5feaf28cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0168c42a-ced0-4874-aa6b-90e01b36b8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0168c42a-ced0-4874-aa6b-90e01b36b8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1fe8745-533e-40a5-b301-ffca67596a93', 'volume_name': 'volume-d1fe8745-533e-40a5-b301-ffca67596a93', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (382c7587-d26a-4794-9a35-448d5e453b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (382c7587-d26a-4794-9a35-448d5e453b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a859ffee-ecac-4b31-a414-5aec9531a3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:19 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Volume d1fe8745-533e-40a5-b301-ffca67596a93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1fe8745-533e-40a5-b301-ffca67596a93', 'volume_size': 1} Apr 16 19:41:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:41:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:41:19 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fcdb4be3-977c-450d-9edb-5b4937c84763,created_at=2026-04-16T17:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1300499444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fcdb4be3-977c-450d-9edb-5b4937c84763,host='devstack@QuobyteHD#QuobyteHD',id=d1fe8745-533e-40a5-b301-ffca67596a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1679651795415e8cf4fe10cf6caced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:41:19Z,use_quota=True,user_id='5459084109c14ccf990630df43e32d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8196e46-5472-454c-9041-6d2bb1f98933),volume_type_id=e8196e46-5472-454c-9041-6d2bb1f98933)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:41:19 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Creating volume d1fe8745-533e-40a5-b301-ffca67596a93 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:41:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:41:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:41:19 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:41:19 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:41:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:41:19 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:41:19 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:41:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:19 devstack sudo[84368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93 1073741824 Apr 16 19:41:19 devstack sudo[84368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:20 devstack sudo[84368]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93 1073741824" returned: 0 in 0.829s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:20 devstack sudo[84396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93 Apr 16 19:41:20 devstack sudo[84396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:21 devstack sudo[84396]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93" returned: 0 in 1.262s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:21 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] <== create_volume: return (2157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:41:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.159s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:41:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a859ffee-ecac-4b31-a414-5aec9531a3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1fe8745-533e-40a5-b301-ffca67596a93', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f9c9adc-7c8c-4fff-9c7e-7988068574b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:21 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Volume volume-d1fe8745-533e-40a5-b301-ffca67596a93 (d1fe8745-533e-40a5-b301-ffca67596a93): created successfully Apr 16 19:41:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f9c9adc-7c8c-4fff-9c7e-7988068574b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Flow 'volume_create_manager' (21f5da14-2c14-461d-8479-3945db876a97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:41:21 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-5b9414b7-2324-4e8d-981d-17815118d949 tempest-GroupSnapshotsTest-1945451735 None] Created volume successfully. Apr 16 19:41:22 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:41:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Flow 'volume_create_manager' (a1389dea-2dd1-4df4-95bc-254df236d889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:41:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a717c8d-cb2e-4dd9-96fb-c10eec5b21e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a717c8d-cb2e-4dd9-96fb-c10eec5b21e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1928499993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=827a042f-656a-41bd-9abb-8b1ff39fa202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357cc5332424486f8f1e9c8dd33cb516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:41:22Z,use_quota=True,user_id='f18e5391b55c4f54b9742caa8e1f59ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (197b874a-41b2-47f1-b40c-624536dbbc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (197b874a-41b2-47f1-b40c-624536dbbc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d688a940-8d88-4fd8-8331-8df7a6a85eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d688a940-8d88-4fd8-8331-8df7a6a85eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '827a042f-656a-41bd-9abb-8b1ff39fa202', 'volume_name': 'volume-827a042f-656a-41bd-9abb-8b1ff39fa202', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c23f4e-5e0b-4a20-ba81-67fc67c07342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c23f4e-5e0b-4a20-ba81-67fc67c07342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ba3cbb-e62d-4ae7-bafe-18d3bc42cc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:22 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Volume 827a042f-656a-41bd-9abb-8b1ff39fa202: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-827a042f-656a-41bd-9abb-8b1ff39fa202', 'volume_size': 1} Apr 16 19:41:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:41:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:41:22 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1928499993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=827a042f-656a-41bd-9abb-8b1ff39fa202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357cc5332424486f8f1e9c8dd33cb516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:41:22Z,use_quota=True,user_id='f18e5391b55c4f54b9742caa8e1f59ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:41:22 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Creating volume 827a042f-656a-41bd-9abb-8b1ff39fa202 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:41:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:41:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:41:22 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:41:22 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:41:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:41:22 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:41:22 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:41:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-827a042f-656a-41bd-9abb-8b1ff39fa202 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:22 devstack sudo[84424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-827a042f-656a-41bd-9abb-8b1ff39fa202 1073741824 Apr 16 19:41:22 devstack sudo[84424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:22 devstack sudo[84424]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-827a042f-656a-41bd-9abb-8b1ff39fa202 1073741824" returned: 0 in 0.617s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-827a042f-656a-41bd-9abb-8b1ff39fa202 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:22 devstack sudo[84430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-827a042f-656a-41bd-9abb-8b1ff39fa202 Apr 16 19:41:22 devstack sudo[84430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:23 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-8c8df70c-efe6-48db-8966-0b4949ac8cb6 tempest-GroupSnapshotsTest-1945451735 None] Update group completed successfully. Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Flow 'volume_create_manager' (a914cbd2-ec9d-4ca9-b43c-a9c6fea0d850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (812d1daa-fd07-4362-a68d-6b49947147bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (812d1daa-fd07-4362-a68d-6b49947147bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1378695053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa41d09-c3d2-4403-b24b-ae11e9c00276,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0375e9ea0b1048f3860338384e282165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:41:23Z,use_quota=True,user_id='77d91889644a4f359eeca552490b89e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4fdfd4-f542-4793-b1ea-c616f12250c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4fdfd4-f542-4793-b1ea-c616f12250c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9dc154-6c06-4da7-b128-66d6ed664c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9dc154-6c06-4da7-b128-66d6ed664c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aa41d09-c3d2-4403-b24b-ae11e9c00276', 'volume_name': 'volume-3aa41d09-c3d2-4403-b24b-ae11e9c00276', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85dddc1-44d5-4f8a-82e6-b1dbb3394263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85dddc1-44d5-4f8a-82e6-b1dbb3394263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b6851f-5ac3-4adb-b2fe-08999dba7af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:23 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Volume 3aa41d09-c3d2-4403-b24b-ae11e9c00276: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aa41d09-c3d2-4403-b24b-ae11e9c00276', 'volume_size': 1} Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:41:23 devstack sudo[84430]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-827a042f-656a-41bd-9abb-8b1ff39fa202" returned: 0 in 0.720s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.054s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1378695053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa41d09-c3d2-4403-b24b-ae11e9c00276,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0375e9ea0b1048f3860338384e282165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:41:23Z,use_quota=True,user_id='77d91889644a4f359eeca552490b89e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Creating volume 3aa41d09-c3d2-4403-b24b-ae11e9c00276 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:41:23 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3aa41d09-c3d2-4403-b24b-ae11e9c00276 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ba3cbb-e62d-4ae7-bafe-18d3bc42cc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-827a042f-656a-41bd-9abb-8b1ff39fa202', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c255f7-d010-4edc-a4eb-a713821d8b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:23 devstack sudo[84434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3aa41d09-c3d2-4403-b24b-ae11e9c00276 1073741824 Apr 16 19:41:23 devstack sudo[84434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:23 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Volume volume-827a042f-656a-41bd-9abb-8b1ff39fa202 (827a042f-656a-41bd-9abb-8b1ff39fa202): created successfully Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c255f7-d010-4edc-a4eb-a713821d8b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Flow 'volume_create_manager' (a1389dea-2dd1-4df4-95bc-254df236d889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:41:23 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-ad48ab9d-b723-4e35-8766-107913721e6f tempest-VolumesAdminNegativeTest-1060887409 None] Created volume successfully. Apr 16 19:41:24 devstack sudo[84434]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3aa41d09-c3d2-4403-b24b-ae11e9c00276 1073741824" returned: 0 in 0.572s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3aa41d09-c3d2-4403-b24b-ae11e9c00276 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:24 devstack sudo[84443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3aa41d09-c3d2-4403-b24b-ae11e9c00276 Apr 16 19:41:24 devstack sudo[84443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:24 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-f4bc3119-43ad-4863-ad11-233ef54da0f4 tempest-GroupSnapshotsTest-1945451735 None] Update group completed successfully. Apr 16 19:41:24 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b1f71bf5-0aea-4836-a2ca-21b8b8ab8132 tempest-VolumesAdminNegativeTest-1060887409 None] Acquiring lock "cinder-827a042f-656a-41bd-9abb-8b1ff39fa202-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:41:24 devstack sudo[84443]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3aa41d09-c3d2-4403-b24b-ae11e9c00276" returned: 0 in 0.571s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:24 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:41:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:41:24 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b1f71bf5-0aea-4836-a2ca-21b8b8ab8132 tempest-VolumesAdminNegativeTest-1060887409 None] Lock "cinder-827a042f-656a-41bd-9abb-8b1ff39fa202-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:41:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b6851f-5ac3-4adb-b2fe-08999dba7af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aa41d09-c3d2-4403-b24b-ae11e9c00276', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22b55a8-08fd-499d-a0b6-ea47026afb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:24 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Volume volume-3aa41d09-c3d2-4403-b24b-ae11e9c00276 (3aa41d09-c3d2-4403-b24b-ae11e9c00276): created successfully Apr 16 19:41:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22b55a8-08fd-499d-a0b6-ea47026afb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Flow 'volume_create_manager' (a914cbd2-ec9d-4ca9-b43c-a9c6fea0d850) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:41:24 devstack cinder-volume[82569]: INFO cinder.volume.manager [req-88035238-e638-4799-b4d1-94deab359b80 req-dd36317c-1d39-4914-9d1e-e2180b8cc2da tempest-VolumesGetTestJSON-1873832525 None] Created volume successfully. Apr 16 19:41:24 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b1f71bf5-0aea-4836-a2ca-21b8b8ab8132 tempest-VolumesAdminNegativeTest-1060887409 None] Acquiring lock "cinder-quobyte-827a042f-656a-41bd-9abb-8b1ff39fa202" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:41:24 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b1f71bf5-0aea-4836-a2ca-21b8b8ab8132 tempest-VolumesAdminNegativeTest-1060887409 None] Lock "cinder-quobyte-827a042f-656a-41bd-9abb-8b1ff39fa202" acquired by "delete_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:41:24 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a942015-7021-4051-be14-64bc557e0b80]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:41:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b1f71bf5-0aea-4836-a2ca-21b8b8ab8132 tempest-VolumesAdminNegativeTest-1060887409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-827a042f-656a-41bd-9abb-8b1ff39fa202 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:24 devstack sudo[84449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-827a042f-656a-41bd-9abb-8b1ff39fa202 Apr 16 19:41:24 devstack sudo[84449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:25 devstack sudo[84449]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b1f71bf5-0aea-4836-a2ca-21b8b8ab8132 tempest-VolumesAdminNegativeTest-1060887409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-827a042f-656a-41bd-9abb-8b1ff39fa202" returned: 0 in 0.513s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b1f71bf5-0aea-4836-a2ca-21b8b8ab8132 tempest-VolumesAdminNegativeTest-1060887409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-827a042f-656a-41bd-9abb-8b1ff39fa202 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:25 devstack sudo[84461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-827a042f-656a-41bd-9abb-8b1ff39fa202 Apr 16 19:41:25 devstack sudo[84461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:25 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-7245420c-c26d-45e3-bd71-19884279d93e tempest-GroupSnapshotsTest-1945451735 None] Update group completed successfully. Apr 16 19:41:25 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-2c4b0a85-095d-4d63-81ee-078a774ce72c req-b101f3c5-0621-46d6-98e8-b7a1da31e2ec tempest-VolumesGetTestJSON-1873832525 None] Acquiring lock "cinder-3aa41d09-c3d2-4403-b24b-ae11e9c00276-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:41:25 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-2c4b0a85-095d-4d63-81ee-078a774ce72c req-b101f3c5-0621-46d6-98e8-b7a1da31e2ec tempest-VolumesGetTestJSON-1873832525 None] Lock "cinder-3aa41d09-c3d2-4403-b24b-ae11e9c00276-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:41:25 devstack sudo[84461]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b1f71bf5-0aea-4836-a2ca-21b8b8ab8132 tempest-VolumesAdminNegativeTest-1060887409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-827a042f-656a-41bd-9abb-8b1ff39fa202" returned: 0 in 0.482s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:25 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b1f71bf5-0aea-4836-a2ca-21b8b8ab8132 tempest-VolumesAdminNegativeTest-1060887409 None] Lock "cinder-quobyte-827a042f-656a-41bd-9abb-8b1ff39fa202" released by "delete_volume" :: held 1.020s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:41:25 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-2c4b0a85-095d-4d63-81ee-078a774ce72c req-b101f3c5-0621-46d6-98e8-b7a1da31e2ec tempest-VolumesGetTestJSON-1873832525 None] Acquiring lock "cinder-quobyte-3aa41d09-c3d2-4403-b24b-ae11e9c00276" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:41:25 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-2c4b0a85-095d-4d63-81ee-078a774ce72c req-b101f3c5-0621-46d6-98e8-b7a1da31e2ec tempest-VolumesGetTestJSON-1873832525 None] Lock "cinder-quobyte-3aa41d09-c3d2-4403-b24b-ae11e9c00276" acquired by "delete_volume" :: waited 0.017s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:41:25 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9234406-606f-42cc-bad1-fe8eb01572f2]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:41:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-2c4b0a85-095d-4d63-81ee-078a774ce72c req-b101f3c5-0621-46d6-98e8-b7a1da31e2ec tempest-VolumesGetTestJSON-1873832525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3aa41d09-c3d2-4403-b24b-ae11e9c00276 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:25 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-b1f71bf5-0aea-4836-a2ca-21b8b8ab8132 tempest-VolumesAdminNegativeTest-1060887409 None] Created reservations ['7bf048dc-1faa-4010-b6af-8955ac120546', '19cb6156-7e03-4fab-8b07-8b3fca8fd921', '6313a87c-2d0a-49a6-88fe-f16e4790e95a', 'e317bc73-3886-49dc-a727-d6a1a28a72bf'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:41:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b1f71bf5-0aea-4836-a2ca-21b8b8ab8132 tempest-VolumesAdminNegativeTest-1060887409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:41:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b1f71bf5-0aea-4836-a2ca-21b8b8ab8132 tempest-VolumesAdminNegativeTest-1060887409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:41:25 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-b1f71bf5-0aea-4836-a2ca-21b8b8ab8132 tempest-VolumesAdminNegativeTest-1060887409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:41:25 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-b1f71bf5-0aea-4836-a2ca-21b8b8ab8132 tempest-VolumesAdminNegativeTest-1060887409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:41:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b1f71bf5-0aea-4836-a2ca-21b8b8ab8132 tempest-VolumesAdminNegativeTest-1060887409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:41:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b1f71bf5-0aea-4836-a2ca-21b8b8ab8132 tempest-VolumesAdminNegativeTest-1060887409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:25 devstack sudo[84464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3aa41d09-c3d2-4403-b24b-ae11e9c00276 Apr 16 19:41:25 devstack sudo[84464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:25 devstack sudo[84465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:41:25 devstack sudo[84465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:26 devstack sudo[84464]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-2c4b0a85-095d-4d63-81ee-078a774ce72c req-b101f3c5-0621-46d6-98e8-b7a1da31e2ec tempest-VolumesGetTestJSON-1873832525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3aa41d09-c3d2-4403-b24b-ae11e9c00276" returned: 0 in 0.559s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-2c4b0a85-095d-4d63-81ee-078a774ce72c req-b101f3c5-0621-46d6-98e8-b7a1da31e2ec tempest-VolumesGetTestJSON-1873832525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3aa41d09-c3d2-4403-b24b-ae11e9c00276 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:26 devstack sudo[84472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3aa41d09-c3d2-4403-b24b-ae11e9c00276 Apr 16 19:41:26 devstack sudo[84472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:26 devstack sudo[84465]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b1f71bf5-0aea-4836-a2ca-21b8b8ab8132 tempest-VolumesAdminNegativeTest-1060887409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.527s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:26 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-b1f71bf5-0aea-4836-a2ca-21b8b8ab8132 tempest-VolumesAdminNegativeTest-1060887409 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:41:26 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-b1f71bf5-0aea-4836-a2ca-21b8b8ab8132 tempest-VolumesAdminNegativeTest-1060887409 None] Deleted volume successfully. Apr 16 19:41:26 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b1f71bf5-0aea-4836-a2ca-21b8b8ab8132 tempest-VolumesAdminNegativeTest-1060887409 None] Lock "cinder-827a042f-656a-41bd-9abb-8b1ff39fa202-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:41:26 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-0d5821b7-a3d4-49dd-81ae-55f172440505 tempest-GroupSnapshotsTest-1945451735 None] Update group completed successfully. Apr 16 19:41:27 devstack sudo[84472]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-2c4b0a85-095d-4d63-81ee-078a774ce72c req-b101f3c5-0621-46d6-98e8-b7a1da31e2ec tempest-VolumesGetTestJSON-1873832525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3aa41d09-c3d2-4403-b24b-ae11e9c00276" returned: 0 in 0.686s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:27 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-2c4b0a85-095d-4d63-81ee-078a774ce72c req-b101f3c5-0621-46d6-98e8-b7a1da31e2ec tempest-VolumesGetTestJSON-1873832525 None] Lock "cinder-quobyte-3aa41d09-c3d2-4403-b24b-ae11e9c00276" released by "delete_volume" :: held 1.268s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:41:27 devstack cinder-volume[82569]: DEBUG cinder.quota [req-2c4b0a85-095d-4d63-81ee-078a774ce72c req-b101f3c5-0621-46d6-98e8-b7a1da31e2ec tempest-VolumesGetTestJSON-1873832525 None] Created reservations ['ece94c05-5601-47e4-84c1-d51587ecd3d6', 'b09fea9b-23e9-4bfd-bb87-e7c76bb4293f', '88a1de47-91aa-4706-877f-6f32ef144965', 'c37f4ca9-71cb-4e42-83e9-ad2842108d2f'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:41:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-2c4b0a85-095d-4d63-81ee-078a774ce72c req-b101f3c5-0621-46d6-98e8-b7a1da31e2ec tempest-VolumesGetTestJSON-1873832525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:41:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-2c4b0a85-095d-4d63-81ee-078a774ce72c req-b101f3c5-0621-46d6-98e8-b7a1da31e2ec tempest-VolumesGetTestJSON-1873832525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:41:27 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-2c4b0a85-095d-4d63-81ee-078a774ce72c req-b101f3c5-0621-46d6-98e8-b7a1da31e2ec tempest-VolumesGetTestJSON-1873832525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:41:27 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-2c4b0a85-095d-4d63-81ee-078a774ce72c req-b101f3c5-0621-46d6-98e8-b7a1da31e2ec tempest-VolumesGetTestJSON-1873832525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:41:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-2c4b0a85-095d-4d63-81ee-078a774ce72c req-b101f3c5-0621-46d6-98e8-b7a1da31e2ec tempest-VolumesGetTestJSON-1873832525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:41:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-2c4b0a85-095d-4d63-81ee-078a774ce72c req-b101f3c5-0621-46d6-98e8-b7a1da31e2ec tempest-VolumesGetTestJSON-1873832525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:27 devstack sudo[84476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:41:27 devstack sudo[84476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:27 devstack sudo[84476]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-2c4b0a85-095d-4d63-81ee-078a774ce72c req-b101f3c5-0621-46d6-98e8-b7a1da31e2ec tempest-VolumesGetTestJSON-1873832525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.426s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:27 devstack cinder-volume[82569]: DEBUG cinder.manager [req-2c4b0a85-095d-4d63-81ee-078a774ce72c req-b101f3c5-0621-46d6-98e8-b7a1da31e2ec tempest-VolumesGetTestJSON-1873832525 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:41:27 devstack cinder-volume[82569]: INFO cinder.volume.manager [req-2c4b0a85-095d-4d63-81ee-078a774ce72c req-b101f3c5-0621-46d6-98e8-b7a1da31e2ec tempest-VolumesGetTestJSON-1873832525 None] Deleted volume successfully. Apr 16 19:41:27 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-2c4b0a85-095d-4d63-81ee-078a774ce72c req-b101f3c5-0621-46d6-98e8-b7a1da31e2ec tempest-VolumesGetTestJSON-1873832525 None] Lock "cinder-3aa41d09-c3d2-4403-b24b-ae11e9c00276-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:41:27 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] GroupSnapshot d351917f-cf76-4eca-b8fb-35855f709b22: creating. Apr 16 19:41:27 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] Group snapshot d351917f-cf76-4eca-b8fb-35855f709b22: creating. {{(pid=82569) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 16 19:41:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:41:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:41:28 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] Creating offline snapshot 37a40594-6002-49e3-9628-e0efd11493a5 of volume 4b32709f-341d-411c-a100-8844483d018c {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:41:28 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3df034a-4d13-4a05-9ad6-a76e9fb07685]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:41:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:28 devstack sudo[84485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c Apr 16 19:41:28 devstack sudo[84485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:28 devstack sudo[84485]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c" returned: 0 in 0.691s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c.37a40594-6002-49e3-9628-e0efd11493a5 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:28 devstack sudo[84513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c.37a40594-6002-49e3-9628-e0efd11493a5 1G Apr 16 19:41:28 devstack sudo[84513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:29 devstack sudo[84513]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c.37a40594-6002-49e3-9628-e0efd11493a5 1G" returned: 0 in 0.678s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b32709f-341d-411c-a100-8844483d018c -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c.37a40594-6002-49e3-9628-e0efd11493a5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:29 devstack sudo[84519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b32709f-341d-411c-a100-8844483d018c -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c.37a40594-6002-49e3-9628-e0efd11493a5 Apr 16 19:41:29 devstack sudo[84519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:30 devstack sudo[84519]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b32709f-341d-411c-a100-8844483d018c -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c.37a40594-6002-49e3-9628-e0efd11493a5" returned: 0 in 0.654s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:30 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c.37a40594-6002-49e3-9628-e0efd11493a5 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 19:41:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c.37a40594-6002-49e3-9628-e0efd11493a5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:30 devstack sudo[84525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c.37a40594-6002-49e3-9628-e0efd11493a5 Apr 16 19:41:30 devstack sudo[84525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:30 devstack sudo[84525]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c.37a40594-6002-49e3-9628-e0efd11493a5" returned: 0 in 0.592s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:30 devstack sudo[84544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c.info Apr 16 19:41:30 devstack sudo[84544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:31 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-ccb00407-f1f9-4875-9271-b3dec27d16ab tempest-GroupsV320Test-767335554 None] Group tempest-GroupsV320Test-Group-724209460: creating Apr 16 19:41:31 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-ccb00407-f1f9-4875-9271-b3dec27d16ab tempest-GroupsV320Test-767335554 None] Group tempest-GroupsV320Test-Group-724209460: created successfully Apr 16 19:41:31 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-ccb00407-f1f9-4875-9271-b3dec27d16ab tempest-GroupsV320Test-767335554 None] Create group completed successfully. Apr 16 19:41:31 devstack sudo[84544]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c.info" returned: 0 in 0.520s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:31 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 19:41:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:31 devstack sudo[84549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c.info Apr 16 19:41:31 devstack sudo[84549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:31 devstack sudo[84549]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c.info" returned: 0 in 0.453s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.650s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:41:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:41:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:41:31 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] Creating offline snapshot 7c81aa04-576e-4613-8e10-2fc42f125f4e of volume d1fe8745-533e-40a5-b301-ffca67596a93 {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:41:31 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2064f9b-efd9-44e7-a915-7018a9237e63]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:41:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:31 devstack sudo[84552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93 Apr 16 19:41:31 devstack sudo[84552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:32 devstack sudo[84552]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93" returned: 0 in 0.480s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93.7c81aa04-576e-4613-8e10-2fc42f125f4e 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:32 devstack sudo[84557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93.7c81aa04-576e-4613-8e10-2fc42f125f4e 1G Apr 16 19:41:32 devstack sudo[84557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:32 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-e6ed9168-14e6-422e-9dad-2a81310c333e tempest-GroupsV320Test-767335554 None] Created reservations ['b3040385-5322-4530-8911-de7dfc00b308'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:41:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e6ed9168-14e6-422e-9dad-2a81310c333e tempest-GroupsV320Test-767335554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:41:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e6ed9168-14e6-422e-9dad-2a81310c333e tempest-GroupsV320Test-767335554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:41:32 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e6ed9168-14e6-422e-9dad-2a81310c333e tempest-GroupsV320Test-767335554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:41:32 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e6ed9168-14e6-422e-9dad-2a81310c333e tempest-GroupsV320Test-767335554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:41:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e6ed9168-14e6-422e-9dad-2a81310c333e tempest-GroupsV320Test-767335554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:41:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e6ed9168-14e6-422e-9dad-2a81310c333e tempest-GroupsV320Test-767335554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:32 devstack sudo[84559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:41:32 devstack sudo[84559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:32 devstack sudo[84557]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93.7c81aa04-576e-4613-8e10-2fc42f125f4e 1G" returned: 0 in 0.684s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1fe8745-533e-40a5-b301-ffca67596a93 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93.7c81aa04-576e-4613-8e10-2fc42f125f4e {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:32 devstack sudo[84564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1fe8745-533e-40a5-b301-ffca67596a93 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93.7c81aa04-576e-4613-8e10-2fc42f125f4e Apr 16 19:41:32 devstack sudo[84564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:33 devstack sudo[84559]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e6ed9168-14e6-422e-9dad-2a81310c333e tempest-GroupsV320Test-767335554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.497s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:33 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-e6ed9168-14e6-422e-9dad-2a81310c333e tempest-GroupsV320Test-767335554 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:41:33 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-e6ed9168-14e6-422e-9dad-2a81310c333e tempest-GroupsV320Test-767335554 None] Delete group completed successfully. Apr 16 19:41:33 devstack sudo[84564]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1fe8745-533e-40a5-b301-ffca67596a93 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93.7c81aa04-576e-4613-8e10-2fc42f125f4e" returned: 0 in 0.501s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:33 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93.7c81aa04-576e-4613-8e10-2fc42f125f4e is being set with open permissions: ugo+rw: NotImplementedError Apr 16 19:41:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93.7c81aa04-576e-4613-8e10-2fc42f125f4e {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:33 devstack sudo[84571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93.7c81aa04-576e-4613-8e10-2fc42f125f4e Apr 16 19:41:33 devstack sudo[84571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:33 devstack sudo[84571]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93.7c81aa04-576e-4613-8e10-2fc42f125f4e" returned: 0 in 0.556s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:33 devstack sudo[84577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93.info Apr 16 19:41:33 devstack sudo[84577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:34 devstack sudo[84577]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93.info" returned: 0 in 0.571s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:34 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 19:41:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:34 devstack sudo[84580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93.info Apr 16 19:41:34 devstack sudo[84580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:35 devstack sudo[84580]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93.info" returned: 0 in 0.522s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.374s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:41:35 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-7fb9aa72-d1a2-43df-80ec-3b64d333efe9 tempest-GroupSnapshotsTest-1945451735 None] group_snapshot d351917f-cf76-4eca-b8fb-35855f709b22: created successfully Apr 16 19:41:35 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] group_snapshot d351917f-cf76-4eca-b8fb-35855f709b22: deleting Apr 16 19:41:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] group_snapshot d351917f-cf76-4eca-b8fb-35855f709b22: deleting {{(pid=82569) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 16 19:41:35 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "cinder-quobyte-4b32709f-341d-411c-a100-8844483d018c" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:41:35 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-4b32709f-341d-411c-a100-8844483d018c" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:41:35 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "cinder-quobyte-37a40594-6002-49e3-9628-e0efd11493a5" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:41:35 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-37a40594-6002-49e3-9628-e0efd11493a5" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:41:35 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Deleting offline snapshot 37a40594-6002-49e3-9628-e0efd11493a5 of volume 4b32709f-341d-411c-a100-8844483d018c {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:41:35 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] snapshot_file for this snap is: volume-4b32709f-341d-411c-a100-8844483d018c.37a40594-6002-49e3-9628-e0efd11493a5 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:41:35 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[9347559f-5088-48f5-bd00-1a0bbe643387]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:41:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c.37a40594-6002-49e3-9628-e0efd11493a5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:35 devstack sudo[84609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c.37a40594-6002-49e3-9628-e0efd11493a5 Apr 16 19:41:35 devstack sudo[84609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:36 devstack sudo[84609]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c.37a40594-6002-49e3-9628-e0efd11493a5" returned: 0 in 0.922s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:36 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b32709f-341d-411c-a100-8844483d018c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:41:36 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[843177ce-c0fc-45bb-93ab-c3e6bd138d42]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:41:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:36 devstack sudo[84618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c Apr 16 19:41:36 devstack sudo[84618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:37 devstack sudo[84618]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c" returned: 0 in 0.686s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c.37a40594-6002-49e3-9628-e0efd11493a5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:37 devstack sudo[84623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c.37a40594-6002-49e3-9628-e0efd11493a5 Apr 16 19:41:37 devstack sudo[84623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:38 devstack sudo[84623]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c.37a40594-6002-49e3-9628-e0efd11493a5" returned: 0 in 1.131s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c.37a40594-6002-49e3-9628-e0efd11493a5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:38 devstack sudo[84630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c.37a40594-6002-49e3-9628-e0efd11493a5 Apr 16 19:41:38 devstack sudo[84630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:39 devstack sudo[84630]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c.37a40594-6002-49e3-9628-e0efd11493a5" returned: 0 in 0.690s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:39 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-37a40594-6002-49e3-9628-e0efd11493a5" released by "_delete_snapshot" :: held 3.563s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:41:39 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-4b32709f-341d-411c-a100-8844483d018c" released by "delete_snapshot" :: held 3.579s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:41:39 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "cinder-quobyte-d1fe8745-533e-40a5-b301-ffca67596a93" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:41:39 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-d1fe8745-533e-40a5-b301-ffca67596a93" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:41:39 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "cinder-quobyte-7c81aa04-576e-4613-8e10-2fc42f125f4e" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:41:39 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-7c81aa04-576e-4613-8e10-2fc42f125f4e" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:41:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Deleting offline snapshot 7c81aa04-576e-4613-8e10-2fc42f125f4e of volume d1fe8745-533e-40a5-b301-ffca67596a93 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:41:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] snapshot_file for this snap is: volume-d1fe8745-533e-40a5-b301-ffca67596a93.7c81aa04-576e-4613-8e10-2fc42f125f4e {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:41:39 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e750c2-7c5d-4779-868e-193c6a8d373c]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:41:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93.7c81aa04-576e-4613-8e10-2fc42f125f4e {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:39 devstack sudo[84634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93.7c81aa04-576e-4613-8e10-2fc42f125f4e Apr 16 19:41:39 devstack sudo[84634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:40 devstack sudo[84634]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93.7c81aa04-576e-4613-8e10-2fc42f125f4e" returned: 0 in 0.832s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1fe8745-533e-40a5-b301-ffca67596a93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:41:40 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18fda16-dbad-47d8-8b18-47fd79ee7b71]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:41:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:40 devstack sudo[84641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93 Apr 16 19:41:40 devstack sudo[84641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:40 devstack sudo[84641]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93" returned: 0 in 0.722s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93.7c81aa04-576e-4613-8e10-2fc42f125f4e {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:40 devstack sudo[84646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93.7c81aa04-576e-4613-8e10-2fc42f125f4e Apr 16 19:41:40 devstack sudo[84646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:41 devstack cinder-volume[82569]: DEBUG dbcounter [-] [82569] Writing DB stats cinder:SELECT=96,cinder:UPDATE=84,cinder:INSERT=18,cinder:DELETE=6 {{(pid=82569) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:41:41 devstack cinder-volume[82569]: DEBUG dbcounter [-] [82569] Writing DB stats cinder:SELECT=115,cinder:UPDATE=100,cinder:INSERT=19,cinder:DELETE=4 {{(pid=82569) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:41:41 devstack sudo[84646]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93.7c81aa04-576e-4613-8e10-2fc42f125f4e" returned: 0 in 1.037s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93.7c81aa04-576e-4613-8e10-2fc42f125f4e {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:41 devstack sudo[84651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93.7c81aa04-576e-4613-8e10-2fc42f125f4e Apr 16 19:41:41 devstack sudo[84651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:42 devstack sudo[84651]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93.7c81aa04-576e-4613-8e10-2fc42f125f4e" returned: 0 in 0.590s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:42 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-7c81aa04-576e-4613-8e10-2fc42f125f4e" released by "_delete_snapshot" :: held 3.260s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:41:42 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-d1fe8745-533e-40a5-b301-ffca67596a93" released by "delete_snapshot" :: held 3.283s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:41:42 devstack cinder-volume[82569]: WARNING cinder.quota [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-517168107 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-517168107, it is now deprecated. Please use the default quota class for default quota. Apr 16 19:41:42 devstack cinder-volume[82569]: WARNING cinder.quota [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-517168107 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-517168107, it is now deprecated. Please use the default quota class for default quota. Apr 16 19:41:42 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Created reservations ['f65342fc-7391-404f-ac4a-bccb0743aae4', 'abd6edc8-ffa9-4339-bf2c-dbbf465b61e7', '42c5f866-3c4b-4a28-a036-6e2e57d8d5cb', '37bd664d-deaf-48e8-ab05-31ba11229abb'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:41:42 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] Created reservations ['164ae42c-87b6-4ae3-8219-f91253f49226', '16e36b4d-d707-4868-8ae1-b7b8ef8bafe0', '97208419-3a93-461e-b66b-6a24ea208fc1', '579f1016-8e60-41b9-bcf9-daa4070cbe37'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:41:42 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-322e54f6-98b5-4a79-b60a-304607542a83 tempest-GroupSnapshotsTest-1945451735 None] group_snapshot d351917f-cf76-4eca-b8fb-35855f709b22: deleted successfully Apr 16 19:41:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1909c3a9-a67c-48dd-a2c0-88f527ff34fd tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "cinder-quobyte-4b32709f-341d-411c-a100-8844483d018c" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:41:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1909c3a9-a67c-48dd-a2c0-88f527ff34fd tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-4b32709f-341d-411c-a100-8844483d018c" acquired by "delete_volume" :: waited 0.027s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:41:43 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fe411c-d1cb-400b-a6ef-7bd79da8f8a2]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:41:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1909c3a9-a67c-48dd-a2c0-88f527ff34fd tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:43 devstack sudo[84687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c Apr 16 19:41:43 devstack sudo[84687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:44 devstack sudo[84687]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1909c3a9-a67c-48dd-a2c0-88f527ff34fd tempest-GroupSnapshotsTest-1945451735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c" returned: 0 in 1.044s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1909c3a9-a67c-48dd-a2c0-88f527ff34fd tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:44 devstack sudo[84702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c Apr 16 19:41:44 devstack sudo[84702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:45 devstack sudo[84702]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1909c3a9-a67c-48dd-a2c0-88f527ff34fd tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b32709f-341d-411c-a100-8844483d018c" returned: 0 in 0.905s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:45 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1909c3a9-a67c-48dd-a2c0-88f527ff34fd tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-4b32709f-341d-411c-a100-8844483d018c" released by "delete_volume" :: held 2.004s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:41:45 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1909c3a9-a67c-48dd-a2c0-88f527ff34fd tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "cinder-quobyte-d1fe8745-533e-40a5-b301-ffca67596a93" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:41:45 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1909c3a9-a67c-48dd-a2c0-88f527ff34fd tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-d1fe8745-533e-40a5-b301-ffca67596a93" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:41:45 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b6d342-b57c-45da-992d-8d4c918c3961]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:41:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1909c3a9-a67c-48dd-a2c0-88f527ff34fd tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:45 devstack sudo[84705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93 Apr 16 19:41:45 devstack sudo[84705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:46 devstack sudo[84705]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1909c3a9-a67c-48dd-a2c0-88f527ff34fd tempest-GroupSnapshotsTest-1945451735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93" returned: 0 in 0.743s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1909c3a9-a67c-48dd-a2c0-88f527ff34fd tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:46 devstack sudo[84711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93 Apr 16 19:41:46 devstack sudo[84711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:46 devstack sudo[84711]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1909c3a9-a67c-48dd-a2c0-88f527ff34fd tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d1fe8745-533e-40a5-b301-ffca67596a93" returned: 0 in 0.527s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:46 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1909c3a9-a67c-48dd-a2c0-88f527ff34fd tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-d1fe8745-533e-40a5-b301-ffca67596a93" released by "delete_volume" :: held 1.322s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:41:47 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-1909c3a9-a67c-48dd-a2c0-88f527ff34fd tempest-GroupSnapshotsTest-1945451735 None] Created reservations ['4475aaae-1ad9-4536-a301-8f15e54c7049'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:41:47 devstack cinder-volume[82569]: WARNING cinder.quota [None req-1909c3a9-a67c-48dd-a2c0-88f527ff34fd tempest-GroupSnapshotsTest-1945451735 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-517168107 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-517168107, it is now deprecated. Please use the default quota class for default quota. Apr 16 19:41:47 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-1909c3a9-a67c-48dd-a2c0-88f527ff34fd tempest-GroupSnapshotsTest-1945451735 None] Created reservations ['88f0051c-8ce8-42c3-991f-6bb20633a9fb', 'feb3269d-9370-4a6a-9edf-61b2a3079f45', 'fae85a96-f7ed-419d-846d-769b1b530e85', '75adcc85-3419-4e3c-ba03-0df8716a8e34'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:41:47 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-1909c3a9-a67c-48dd-a2c0-88f527ff34fd tempest-GroupSnapshotsTest-1945451735 None] Created reservations ['338358f1-56de-49d6-980f-b73793a61b1c', '5d9a674a-2f33-4736-bb1a-58c48a3b22a5', '5453a791-c5f1-4330-9b45-cf159e46b471', '4c3e46b2-09de-45d5-919c-d9edd06fac7f'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:41:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1909c3a9-a67c-48dd-a2c0-88f527ff34fd tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:41:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1909c3a9-a67c-48dd-a2c0-88f527ff34fd tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:41:47 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1909c3a9-a67c-48dd-a2c0-88f527ff34fd tempest-GroupSnapshotsTest-1945451735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:41:47 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1909c3a9-a67c-48dd-a2c0-88f527ff34fd tempest-GroupSnapshotsTest-1945451735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:41:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1909c3a9-a67c-48dd-a2c0-88f527ff34fd tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:41:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1909c3a9-a67c-48dd-a2c0-88f527ff34fd tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:47 devstack sudo[84714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:41:47 devstack sudo[84714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:48 devstack sudo[84714]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1909c3a9-a67c-48dd-a2c0-88f527ff34fd tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.882s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:48 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-1909c3a9-a67c-48dd-a2c0-88f527ff34fd tempest-GroupSnapshotsTest-1945451735 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:41:48 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-1909c3a9-a67c-48dd-a2c0-88f527ff34fd tempest-GroupSnapshotsTest-1945451735 None] Delete group completed successfully. Apr 16 19:41:48 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-4b38eefb-b3ac-4aed-b1fa-f61e6f47a5ad tempest-GroupSnapshotsTest-1945451735 None] Group tempest-GroupSnapshotsTest-Group-1575789801: creating Apr 16 19:41:48 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-4b38eefb-b3ac-4aed-b1fa-f61e6f47a5ad tempest-GroupSnapshotsTest-1945451735 None] Group tempest-GroupSnapshotsTest-Group-1575789801: created successfully Apr 16 19:41:48 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-4b38eefb-b3ac-4aed-b1fa-f61e6f47a5ad tempest-GroupSnapshotsTest-1945451735 None] Create group completed successfully. Apr 16 19:41:50 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:41:50 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Flow 'volume_create_manager' (1c5cf01f-c01a-4592-a11a-d3a0b2a44d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:41:50 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a1039f-9398-4941-a25c-14638c07118b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:50 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a1039f-9398-4941-a25c-14638c07118b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1315864207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=92215857-9978-4b0c-ab91-3f7ed3203f2c,host='devstack@QuobyteHD#QuobyteHD',id=0bcef098-a7a0-4948-8e6d-703a6e146734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1679651795415e8cf4fe10cf6caced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:41:50Z,use_quota=True,user_id='5459084109c14ccf990630df43e32d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0fdb211a-e874-463c-b13a-686c28417b58),volume_type_id=0fdb211a-e874-463c-b13a-686c28417b58)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:50 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da91941-de18-43ee-9867-bc1af8dbf6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:50 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da91941-de18-43ee-9867-bc1af8dbf6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:50 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900a813a-b16c-400f-bb98-86bb13f30626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:50 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900a813a-b16c-400f-bb98-86bb13f30626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bcef098-a7a0-4948-8e6d-703a6e146734', 'volume_name': 'volume-0bcef098-a7a0-4948-8e6d-703a6e146734', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:50 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (917f7f6c-00e2-4928-bb49-b06306c7f138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:50 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (917f7f6c-00e2-4928-bb49-b06306c7f138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:50 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c537af9-ec14-4e69-a161-43d7b3485500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:50 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Volume 0bcef098-a7a0-4948-8e6d-703a6e146734: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bcef098-a7a0-4948-8e6d-703a6e146734', 'volume_size': 1} Apr 16 19:41:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:41:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:41:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=92215857-9978-4b0c-ab91-3f7ed3203f2c,created_at=2026-04-16T17:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1315864207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=92215857-9978-4b0c-ab91-3f7ed3203f2c,host='devstack@QuobyteHD#QuobyteHD',id=0bcef098-a7a0-4948-8e6d-703a6e146734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1679651795415e8cf4fe10cf6caced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:41:50Z,use_quota=True,user_id='5459084109c14ccf990630df43e32d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0fdb211a-e874-463c-b13a-686c28417b58),volume_type_id=0fdb211a-e874-463c-b13a-686c28417b58)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:41:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Creating volume 0bcef098-a7a0-4948-8e6d-703a6e146734 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:41:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:41:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:41:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:41:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:41:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:41:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:41:50 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:41:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:50 devstack sudo[84724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734 1073741824 Apr 16 19:41:50 devstack sudo[84724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:51 devstack sudo[84724]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734 1073741824" returned: 0 in 0.821s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:51 devstack sudo[84732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734 Apr 16 19:41:51 devstack sudo[84732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:51 devstack sudo[84732]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734" returned: 0 in 0.666s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:51 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:41:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:41:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c537af9-ec14-4e69-a161-43d7b3485500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bcef098-a7a0-4948-8e6d-703a6e146734', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72f338ba-f5e1-486c-b865-9fd7c9bf29de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:51 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Volume volume-0bcef098-a7a0-4948-8e6d-703a6e146734 (0bcef098-a7a0-4948-8e6d-703a6e146734): created successfully Apr 16 19:41:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72f338ba-f5e1-486c-b865-9fd7c9bf29de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Flow 'volume_create_manager' (1c5cf01f-c01a-4592-a11a-d3a0b2a44d2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:41:51 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-1c11347c-9157-4523-9478-dec0327880b8 tempest-GroupSnapshotsTest-1945451735 None] Created volume successfully. Apr 16 19:41:52 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-8fa2cf6d-50a9-47f3-958e-6b6f7c1bbbcf tempest-GroupSnapshotsTest-1945451735 None] GroupSnapshot d65c0759-a0cf-4154-9391-7dda54a253cc: creating. Apr 16 19:41:52 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-8fa2cf6d-50a9-47f3-958e-6b6f7c1bbbcf tempest-GroupSnapshotsTest-1945451735 None] Group snapshot d65c0759-a0cf-4154-9391-7dda54a253cc: creating. {{(pid=82569) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 16 19:41:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-8fa2cf6d-50a9-47f3-958e-6b6f7c1bbbcf tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:41:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-8fa2cf6d-50a9-47f3-958e-6b6f7c1bbbcf tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:41:52 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-8fa2cf6d-50a9-47f3-958e-6b6f7c1bbbcf tempest-GroupSnapshotsTest-1945451735 None] Creating offline snapshot 74ebd455-0976-4bc3-86a6-ce7a8f71acb5 of volume 0bcef098-a7a0-4948-8e6d-703a6e146734 {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:41:52 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd014ee-17e8-49ca-9d9e-90ac7c84685f]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:41:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8fa2cf6d-50a9-47f3-958e-6b6f7c1bbbcf tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:52 devstack sudo[84738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734 Apr 16 19:41:52 devstack sudo[84738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:53 devstack sudo[84738]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8fa2cf6d-50a9-47f3-958e-6b6f7c1bbbcf tempest-GroupSnapshotsTest-1945451735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734" returned: 0 in 0.853s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8fa2cf6d-50a9-47f3-958e-6b6f7c1bbbcf tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734.74ebd455-0976-4bc3-86a6-ce7a8f71acb5 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:53 devstack sudo[84745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734.74ebd455-0976-4bc3-86a6-ce7a8f71acb5 1G Apr 16 19:41:53 devstack sudo[84745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:54 devstack sudo[84745]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8fa2cf6d-50a9-47f3-958e-6b6f7c1bbbcf tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734.74ebd455-0976-4bc3-86a6-ce7a8f71acb5 1G" returned: 0 in 1.308s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8fa2cf6d-50a9-47f3-958e-6b6f7c1bbbcf tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bcef098-a7a0-4948-8e6d-703a6e146734 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734.74ebd455-0976-4bc3-86a6-ce7a8f71acb5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:54 devstack sudo[84751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bcef098-a7a0-4948-8e6d-703a6e146734 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734.74ebd455-0976-4bc3-86a6-ce7a8f71acb5 Apr 16 19:41:54 devstack sudo[84751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:55 devstack sudo[84751]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8fa2cf6d-50a9-47f3-958e-6b6f7c1bbbcf tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bcef098-a7a0-4948-8e6d-703a6e146734 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734.74ebd455-0976-4bc3-86a6-ce7a8f71acb5" returned: 0 in 0.858s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:55 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-8fa2cf6d-50a9-47f3-958e-6b6f7c1bbbcf tempest-GroupSnapshotsTest-1945451735 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734.74ebd455-0976-4bc3-86a6-ce7a8f71acb5 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 19:41:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8fa2cf6d-50a9-47f3-958e-6b6f7c1bbbcf tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734.74ebd455-0976-4bc3-86a6-ce7a8f71acb5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:55 devstack sudo[84758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734.74ebd455-0976-4bc3-86a6-ce7a8f71acb5 Apr 16 19:41:55 devstack sudo[84758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:55 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:41:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Flow 'volume_create_manager' (7c0b5e12-aefb-45f4-95e0-c67d180029cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:41:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1dd1f9f-dfaf-4ee7-adfc-e78d0cd40a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1dd1f9f-dfaf-4ee7-adfc-e78d0cd40a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:41:56Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce1e2e6a-535f-4105-a70c-97911979c859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f9b942d7554be7901b305e56f78572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:41:56Z,use_quota=True,user_id='a426989df2c24315bff842cff12285cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4d89e4-ea96-40f7-8bb5-71c32e4a17ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4d89e4-ea96-40f7-8bb5-71c32e4a17ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d7d9119-78c5-4581-b665-8b132b33aa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:56 devstack cinder-volume[82569]: DEBUG cinder.image.glance [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Creating Keystone auth plugin from conf {{(pid=82569) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 19:41:56 devstack sudo[84758]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8fa2cf6d-50a9-47f3-958e-6b6f7c1bbbcf tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734.74ebd455-0976-4bc3-86a6-ce7a8f71acb5" returned: 0 in 0.640s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8fa2cf6d-50a9-47f3-958e-6b6f7c1bbbcf tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:56 devstack sudo[84761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734.info Apr 16 19:41:56 devstack sudo[84761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d7d9119-78c5-4581-b665-8b132b33aa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ce1e2e6a-535f-4105-a70c-97911979c859', 'volume_name': 'volume-ce1e2e6a-535f-4105-a70c-97911979c859', 'volume_size': 1, 'image_id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b20df0c408546a0a2fd4c69a0f4b468', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'created_at': datetime.datetime(2026, 4, 16, 17, 35, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 17, 35, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b1155d-12c8-45a1-855a-6ac292ef9011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b1155d-12c8-45a1-855a-6ac292ef9011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:41:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99be0008-3cfd-4ec8-b44e-19c6d10437b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:41:56 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Volume ce1e2e6a-535f-4105-a70c-97911979c859: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ce1e2e6a-535f-4105-a70c-97911979c859', 'volume_size': 1, 'image_id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b20df0c408546a0a2fd4c69a0f4b468', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'created_at': datetime.datetime(2026, 4, 16, 17, 35, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 17, 35, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 19:41:56 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Trying to clone ce1e2e6a-535f-4105-a70c-97911979c859 from image ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'metadata': {}}]). {{(pid=82569) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 19:41:56 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_28dcg5a8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82569) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 19:41:56 devstack cinder-volume[82569]: INFO cinder.image.image_utils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Image download 20.69 MB at 20.69 MB/s Apr 16 19:41:57 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[3753faba-aea4-47d6-b614-dcb7f288f17d]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:41:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_28dcg5a8devstack@QuobyteHD {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:57 devstack sudo[84784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_28dcg5a8devstack@QuobyteHD Apr 16 19:41:57 devstack sudo[84784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:57 devstack sudo[84761]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8fa2cf6d-50a9-47f3-958e-6b6f7c1bbbcf tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734.info" returned: 0 in 0.972s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:57 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-8fa2cf6d-50a9-47f3-958e-6b6f7c1bbbcf tempest-GroupSnapshotsTest-1945451735 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 19:41:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8fa2cf6d-50a9-47f3-958e-6b6f7c1bbbcf tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:57 devstack sudo[84787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734.info Apr 16 19:41:57 devstack sudo[84787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:58 devstack sudo[84787]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8fa2cf6d-50a9-47f3-958e-6b6f7c1bbbcf tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734.info" returned: 0 in 0.784s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-8fa2cf6d-50a9-47f3-958e-6b6f7c1bbbcf tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.495s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:41:58 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-8fa2cf6d-50a9-47f3-958e-6b6f7c1bbbcf tempest-GroupSnapshotsTest-1945451735 None] group_snapshot d65c0759-a0cf-4154-9391-7dda54a253cc: created successfully Apr 16 19:41:58 devstack sudo[84784]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_28dcg5a8devstack@QuobyteHD" returned: 0 in 1.135s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:58 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Temporary image ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 is fetched for user a426989df2c24315bff842cff12285cf. {{(pid=82569) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 19:41:58 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[784eaf0c-3911-45e9-8a68-05d07e225164]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:41:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_28dcg5a8devstack@QuobyteHD {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:58 devstack sudo[84793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_28dcg5a8devstack@QuobyteHD Apr 16 19:41:58 devstack sudo[84793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:59 devstack sudo[84793]: pam_unix(sudo:session): session closed for user root Apr 16 19:41:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_28dcg5a8devstack@QuobyteHD" returned: 0 in 0.903s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:41:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:41:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:41:59 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:41:56Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce1e2e6a-535f-4105-a70c-97911979c859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f9b942d7554be7901b305e56f78572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:41:56Z,use_quota=True,user_id='a426989df2c24315bff842cff12285cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:41:59 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Creating volume ce1e2e6a-535f-4105-a70c-97911979c859 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:41:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:41:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:41:59 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:41:59 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:41:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:41:59 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:41:59 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:41:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:59 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-1952f5cb-739c-40e3-9b75-540b13ea5168 tempest-GroupSnapshotsTest-1945451735 None] group_snapshot d65c0759-a0cf-4154-9391-7dda54a253cc: deleting Apr 16 19:41:59 devstack sudo[84806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859 1073741824 Apr 16 19:41:59 devstack sudo[84806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:41:59 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1952f5cb-739c-40e3-9b75-540b13ea5168 tempest-GroupSnapshotsTest-1945451735 None] group_snapshot d65c0759-a0cf-4154-9391-7dda54a253cc: deleting {{(pid=82569) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 16 19:41:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1952f5cb-739c-40e3-9b75-540b13ea5168 tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "cinder-quobyte-0bcef098-a7a0-4948-8e6d-703a6e146734" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:41:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1952f5cb-739c-40e3-9b75-540b13ea5168 tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-0bcef098-a7a0-4948-8e6d-703a6e146734" acquired by "delete_snapshot" :: waited 0.033s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:41:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1952f5cb-739c-40e3-9b75-540b13ea5168 tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "cinder-quobyte-74ebd455-0976-4bc3-86a6-ce7a8f71acb5" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:41:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1952f5cb-739c-40e3-9b75-540b13ea5168 tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-74ebd455-0976-4bc3-86a6-ce7a8f71acb5" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:41:59 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-1952f5cb-739c-40e3-9b75-540b13ea5168 tempest-GroupSnapshotsTest-1945451735 None] Deleting offline snapshot 74ebd455-0976-4bc3-86a6-ce7a8f71acb5 of volume 0bcef098-a7a0-4948-8e6d-703a6e146734 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:41:59 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-1952f5cb-739c-40e3-9b75-540b13ea5168 tempest-GroupSnapshotsTest-1945451735 None] snapshot_file for this snap is: volume-0bcef098-a7a0-4948-8e6d-703a6e146734.74ebd455-0976-4bc3-86a6-ce7a8f71acb5 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:41:59 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a28f88-8022-42ad-a6ef-0542b3efec61]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:41:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1952f5cb-739c-40e3-9b75-540b13ea5168 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734.74ebd455-0976-4bc3-86a6-ce7a8f71acb5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:41:59 devstack sudo[84809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734.74ebd455-0976-4bc3-86a6-ce7a8f71acb5 Apr 16 19:41:59 devstack sudo[84809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:00 devstack sudo[84806]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859 1073741824" returned: 0 in 1.229s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:00 devstack sudo[84834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859 Apr 16 19:42:00 devstack sudo[84834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:00 devstack sudo[84809]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1952f5cb-739c-40e3-9b75-540b13ea5168 tempest-GroupSnapshotsTest-1945451735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734.74ebd455-0976-4bc3-86a6-ce7a8f71acb5" returned: 0 in 1.327s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:00 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-1952f5cb-739c-40e3-9b75-540b13ea5168 tempest-GroupSnapshotsTest-1945451735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bcef098-a7a0-4948-8e6d-703a6e146734(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:42:00 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[857aa117-96c5-47dd-ac4f-b94c5d01c8a1]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:42:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1952f5cb-739c-40e3-9b75-540b13ea5168 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:01 devstack sudo[84839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734 Apr 16 19:42:01 devstack sudo[84839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:01 devstack sudo[84834]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859" returned: 0 in 0.940s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:01 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] <== create_volume: return (2245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:42:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.250s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:42:01 devstack cinder-volume[82569]: DEBUG cinder.volume.volume_utils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Attempting download of ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'metadata': {}}])) to volume ce1e2e6a-535f-4105-a70c-97911979c859. {{(pid=82569) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 16 19:42:01 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e690f2f-2321-4549-bc90-8392679183f7]: (4, 'raw') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:42:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_jc4ey7n_ {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:01 devstack sudo[84843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_jc4ey7n_ Apr 16 19:42:01 devstack sudo[84843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:01 devstack sudo[84839]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1952f5cb-739c-40e3-9b75-540b13ea5168 tempest-GroupSnapshotsTest-1945451735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734" returned: 0 in 0.984s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1952f5cb-739c-40e3-9b75-540b13ea5168 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734.74ebd455-0976-4bc3-86a6-ce7a8f71acb5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:01 devstack sudo[84848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734.74ebd455-0976-4bc3-86a6-ce7a8f71acb5 Apr 16 19:42:01 devstack sudo[84848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:02 devstack sudo[84843]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_jc4ey7n_" returned: 0 in 1.118s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_jc4ey7n_ {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:02 devstack sudo[84852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_jc4ey7n_ Apr 16 19:42:02 devstack sudo[84852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:02 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:42:02 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Flow 'volume_create_manager' (06cc8495-098c-49c7-851e-c7fb442859ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5289f0d-9257-4673-a0f3-ca23f13dc0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:03 devstack sudo[84848]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5289f0d-9257-4673-a0f3-ca23f13dc0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1287805960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f54d0da7-68aa-4fde-b395-9ff9a4fad4b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77091e6f39594ff6bc27d86f1b3bed2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:42:03Z,use_quota=True,user_id='0b47c18050e442dba619a25cbbbdd654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df39481f-c7eb-4a04-b24f-17645b78a4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df39481f-c7eb-4a04-b24f-17645b78a4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c57abb0-0721-4b47-b051-9d1468bfecca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c57abb0-0721-4b47-b051-9d1468bfecca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f54d0da7-68aa-4fde-b395-9ff9a4fad4b4', 'volume_name': 'volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5a2801c-24ea-4605-b2ac-85391234f34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5a2801c-24ea-4605-b2ac-85391234f34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2e7da1-648c-4d29-a139-d713da529e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:03 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Volume f54d0da7-68aa-4fde-b395-9ff9a4fad4b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4', 'volume_size': 1} Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1287805960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f54d0da7-68aa-4fde-b395-9ff9a4fad4b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77091e6f39594ff6bc27d86f1b3bed2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:42:03Z,use_quota=True,user_id='0b47c18050e442dba619a25cbbbdd654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Creating volume f54d0da7-68aa-4fde-b395-9ff9a4fad4b4 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:42:03 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1952f5cb-739c-40e3-9b75-540b13ea5168 tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734.74ebd455-0976-4bc3-86a6-ce7a8f71acb5" returned: 0 in 1.213s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1952f5cb-739c-40e3-9b75-540b13ea5168 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734.74ebd455-0976-4bc3-86a6-ce7a8f71acb5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:03 devstack sudo[84857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4 1073741824 Apr 16 19:42:03 devstack sudo[84857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:03 devstack sudo[84858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734.74ebd455-0976-4bc3-86a6-ce7a8f71acb5 Apr 16 19:42:03 devstack sudo[84858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:03 devstack sudo[84852]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_jc4ey7n_" returned: 1 in 0.893s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_jc4ey7n_' failed. Not Retrying. {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd03909-2643-4da6-b108-a48dd7bcc551]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_28dcg5a8devstack@QuobyteHD {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:03 devstack sudo[84864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_28dcg5a8devstack@QuobyteHD Apr 16 19:42:03 devstack sudo[84864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:03 devstack sudo[84857]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4 1073741824" returned: 0 in 0.830s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:04 devstack sudo[84870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4 Apr 16 19:42:04 devstack sudo[84870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:04 devstack cinder-volume[82569]: DEBUG oslo_service.periodic_task [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82569) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 19:42:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:42:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:42:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:42:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:42:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:42:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:04 devstack sudo[84872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:42:04 devstack sudo[84872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:04 devstack sudo[84858]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1952f5cb-739c-40e3-9b75-540b13ea5168 tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734.74ebd455-0976-4bc3-86a6-ce7a8f71acb5" returned: 0 in 1.068s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:04 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1952f5cb-739c-40e3-9b75-540b13ea5168 tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-74ebd455-0976-4bc3-86a6-ce7a8f71acb5" released by "_delete_snapshot" :: held 4.705s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:42:04 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1952f5cb-739c-40e3-9b75-540b13ea5168 tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-0bcef098-a7a0-4948-8e6d-703a6e146734" released by "delete_snapshot" :: held 4.735s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:42:04 devstack cinder-volume[82569]: WARNING cinder.quota [None req-1952f5cb-739c-40e3-9b75-540b13ea5168 tempest-GroupSnapshotsTest-1945451735 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-761969050 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-761969050, it is now deprecated. Please use the default quota class for default quota. Apr 16 19:42:04 devstack cinder-volume[82569]: WARNING cinder.quota [None req-1952f5cb-739c-40e3-9b75-540b13ea5168 tempest-GroupSnapshotsTest-1945451735 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-761969050 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-761969050, it is now deprecated. Please use the default quota class for default quota. Apr 16 19:42:04 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-1952f5cb-739c-40e3-9b75-540b13ea5168 tempest-GroupSnapshotsTest-1945451735 None] Created reservations ['33cd46fb-2c5c-4064-aca5-f516718b9317', '1db363a6-0b53-4420-8efd-7141ff5cb7e7', '5c97607a-c2b1-4991-97be-392084372613', 'fae85318-83bc-4891-840a-d1c2685880d8'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:42:04 devstack sudo[84864]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_28dcg5a8devstack@QuobyteHD" returned: 0 in 0.886s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:04 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 was qcow2, converting to raw {{(pid=82569) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 19:42:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_28dcg5a8devstack@QuobyteHD /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:04 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-1952f5cb-739c-40e3-9b75-540b13ea5168 tempest-GroupSnapshotsTest-1945451735 None] group_snapshot d65c0759-a0cf-4154-9391-7dda54a253cc: deleted successfully Apr 16 19:42:04 devstack sudo[84880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_28dcg5a8devstack@QuobyteHD /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859 Apr 16 19:42:04 devstack sudo[84880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:04 devstack sudo[84870]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4" returned: 0 in 0.936s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:42:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:42:04 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2e7da1-648c-4d29-a139-d713da529e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:04 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57c33f9-79b7-4a8b-aedd-918e93bb5692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:04 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Volume volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4 (f54d0da7-68aa-4fde-b395-9ff9a4fad4b4): created successfully Apr 16 19:42:04 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57c33f9-79b7-4a8b-aedd-918e93bb5692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:04 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Flow 'volume_create_manager' (06cc8495-098c-49c7-851e-c7fb442859ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:42:04 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-30fe2042-d8cc-4fc4-a98f-a6e5fe2d8d51 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Created volume successfully. Apr 16 19:42:05 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1ffbb56f-0ab4-41fc-8a1d-c053393927d0 tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "cinder-quobyte-0bcef098-a7a0-4948-8e6d-703a6e146734" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:42:05 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1ffbb56f-0ab4-41fc-8a1d-c053393927d0 tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-0bcef098-a7a0-4948-8e6d-703a6e146734" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:42:05 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea3d7d2-6aae-4438-a414-f8819d25752b]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:42:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1ffbb56f-0ab4-41fc-8a1d-c053393927d0 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:05 devstack sudo[84872]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 1.055s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:05 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:42:05 devstack sudo[84885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734 Apr 16 19:42:05 devstack sudo[84885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a8d17bde-576e-4a19-9d27-23dea58e9c94 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:42:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a8d17bde-576e-4a19-9d27-23dea58e9c94 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:42:05 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-a8d17bde-576e-4a19-9d27-23dea58e9c94 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Creating offline snapshot be8ea65f-ff06-4c66-a0e0-24ccaa1cb753 of volume f54d0da7-68aa-4fde-b395-9ff9a4fad4b4 {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:42:05 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ac5abf-8642-4728-b452-fe7f2c59fca0]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:42:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a8d17bde-576e-4a19-9d27-23dea58e9c94 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:05 devstack sudo[84911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4 Apr 16 19:42:05 devstack sudo[84911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:06 devstack sudo[84885]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1ffbb56f-0ab4-41fc-8a1d-c053393927d0 tempest-GroupSnapshotsTest-1945451735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734" returned: 0 in 0.925s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1ffbb56f-0ab4-41fc-8a1d-c053393927d0 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:06 devstack sudo[84916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734 Apr 16 19:42:06 devstack sudo[84916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:06 devstack sudo[84880]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_28dcg5a8devstack@QuobyteHD /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859" returned: 0 in 1.797s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:06 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_28dcg5a8devstack@QuobyteHD, size 112.00 MB, duration 1.80 sec, destination /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859 {{(pid=82569) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 19:42:06 devstack cinder-volume[82569]: INFO cinder.image.image_utils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Converted 112.00 MB image at 62.28 MB/s Apr 16 19:42:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:06 devstack sudo[84920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859 1G Apr 16 19:42:06 devstack sudo[84920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:06 devstack sudo[84911]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a8d17bde-576e-4a19-9d27-23dea58e9c94 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4" returned: 0 in 0.784s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a8d17bde-576e-4a19-9d27-23dea58e9c94 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4.be8ea65f-ff06-4c66-a0e0-24ccaa1cb753 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:06 devstack sudo[84926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4.be8ea65f-ff06-4c66-a0e0-24ccaa1cb753 1G Apr 16 19:42:06 devstack sudo[84926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:06 devstack sudo[84916]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1ffbb56f-0ab4-41fc-8a1d-c053393927d0 tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0bcef098-a7a0-4948-8e6d-703a6e146734" returned: 0 in 0.630s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:06 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1ffbb56f-0ab4-41fc-8a1d-c053393927d0 tempest-GroupSnapshotsTest-1945451735 None] Lock "cinder-quobyte-0bcef098-a7a0-4948-8e6d-703a6e146734" released by "delete_volume" :: held 1.600s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:42:06 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-1ffbb56f-0ab4-41fc-8a1d-c053393927d0 tempest-GroupSnapshotsTest-1945451735 None] Created reservations ['8f7eb05f-ee33-48ba-a2ec-aeb03e68aab3'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:42:06 devstack cinder-volume[82569]: WARNING cinder.quota [None req-1ffbb56f-0ab4-41fc-8a1d-c053393927d0 tempest-GroupSnapshotsTest-1945451735 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-761969050 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-761969050, it is now deprecated. Please use the default quota class for default quota. Apr 16 19:42:06 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-1ffbb56f-0ab4-41fc-8a1d-c053393927d0 tempest-GroupSnapshotsTest-1945451735 None] Created reservations ['27c2df58-e513-4c66-a78d-b804699b4667', 'f45ba7ce-8bcb-4659-8cc6-777a67f28a0d', 'eeb377ef-e0d9-4534-b375-f3f41d80b770', 'd33196ef-5923-4f28-a8bb-86ae2392aa75'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:42:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1ffbb56f-0ab4-41fc-8a1d-c053393927d0 tempest-GroupSnapshotsTest-1945451735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:42:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1ffbb56f-0ab4-41fc-8a1d-c053393927d0 tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:42:06 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1ffbb56f-0ab4-41fc-8a1d-c053393927d0 tempest-GroupSnapshotsTest-1945451735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:42:06 devstack sudo[84920]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:06 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1ffbb56f-0ab4-41fc-8a1d-c053393927d0 tempest-GroupSnapshotsTest-1945451735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:42:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1ffbb56f-0ab4-41fc-8a1d-c053393927d0 tempest-GroupSnapshotsTest-1945451735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:42:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1ffbb56f-0ab4-41fc-8a1d-c053393927d0 tempest-GroupSnapshotsTest-1945451735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859 1G" returned: 0 in 0.736s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:06 devstack sudo[84931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:42:06 devstack sudo[84931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:06 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[da19ef63-742b-4f62-89f4-77ebda40737a]: (4, 'raw') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:42:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:07 devstack sudo[84933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859 Apr 16 19:42:07 devstack sudo[84933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:07 devstack sudo[84926]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a8d17bde-576e-4a19-9d27-23dea58e9c94 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4.be8ea65f-ff06-4c66-a0e0-24ccaa1cb753 1G" returned: 0 in 0.903s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a8d17bde-576e-4a19-9d27-23dea58e9c94 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4.be8ea65f-ff06-4c66-a0e0-24ccaa1cb753 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:07 devstack sudo[84939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4.be8ea65f-ff06-4c66-a0e0-24ccaa1cb753 Apr 16 19:42:07 devstack sudo[84939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:07 devstack sudo[84931]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1ffbb56f-0ab4-41fc-8a1d-c053393927d0 tempest-GroupSnapshotsTest-1945451735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.614s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:07 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-1ffbb56f-0ab4-41fc-8a1d-c053393927d0 tempest-GroupSnapshotsTest-1945451735 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:42:07 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-1ffbb56f-0ab4-41fc-8a1d-c053393927d0 tempest-GroupSnapshotsTest-1945451735 None] Delete group completed successfully. Apr 16 19:42:07 devstack sudo[84933]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859" returned: 0 in 0.951s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:08 devstack sudo[84943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859 Apr 16 19:42:08 devstack sudo[84943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:08 devstack sudo[84939]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a8d17bde-576e-4a19-9d27-23dea58e9c94 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4.be8ea65f-ff06-4c66-a0e0-24ccaa1cb753" returned: 0 in 0.919s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:08 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-a8d17bde-576e-4a19-9d27-23dea58e9c94 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4.be8ea65f-ff06-4c66-a0e0-24ccaa1cb753 is being set with open permissions: ugo+rw Apr 16 19:42:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a8d17bde-576e-4a19-9d27-23dea58e9c94 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4.be8ea65f-ff06-4c66-a0e0-24ccaa1cb753 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:08 devstack sudo[84948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4.be8ea65f-ff06-4c66-a0e0-24ccaa1cb753 Apr 16 19:42:08 devstack sudo[84948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:08 devstack sudo[84943]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859" returned: 1 in 0.724s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859' failed. Not Retrying. {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 19:42:08 devstack cinder-volume[82569]: DEBUG cinder.volume.volume_utils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Downloaded image ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'metadata': {}}])) to volume ce1e2e6a-535f-4105-a70c-97911979c859 successfully. {{(pid=82569) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 16 19:42:08 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Temporary image ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 for user a426989df2c24315bff842cff12285cf is deleted. {{(pid=82569) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 19:42:08 devstack cinder-volume[82569]: DEBUG cinder.volume.volume_utils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Marking volume ce1e2e6a-535f-4105-a70c-97911979c859 as bootable. {{(pid=82569) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 16 19:42:08 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Copying metadata from image ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 to ce1e2e6a-535f-4105-a70c-97911979c859. {{(pid=82569) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 19:42:08 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Creating volume glance metadata for volume ce1e2e6a-535f-4105-a70c-97911979c859 backed by image ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82569) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 19:42:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99be0008-3cfd-4ec8-b44e-19c6d10437b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce1e2e6a-535f-4105-a70c-97911979c859', 'volume_size': 1, 'image_id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b20df0c408546a0a2fd4c69a0f4b468', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'created_at': datetime.datetime(2026, 4, 16, 17, 35, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 17, 35, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006be8d2-25cf-4451-8909-cad1bf02ec0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:08 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Volume volume-ce1e2e6a-535f-4105-a70c-97911979c859 (ce1e2e6a-535f-4105-a70c-97911979c859): created successfully Apr 16 19:42:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006be8d2-25cf-4451-8909-cad1bf02ec0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Flow 'volume_create_manager' (7c0b5e12-aefb-45f4-95e0-c67d180029cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:42:08 devstack cinder-volume[82569]: INFO cinder.volume.manager [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-928df035-9af6-4be4-aa7d-436f36420193 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Created volume successfully. Apr 16 19:42:08 devstack sudo[84948]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a8d17bde-576e-4a19-9d27-23dea58e9c94 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4.be8ea65f-ff06-4c66-a0e0-24ccaa1cb753" returned: 0 in 0.595s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a8d17bde-576e-4a19-9d27-23dea58e9c94 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:09 devstack sudo[84954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4.info Apr 16 19:42:09 devstack sudo[84954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:09 devstack sudo[84954]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a8d17bde-576e-4a19-9d27-23dea58e9c94 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4.info" returned: 0 in 0.694s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:09 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-a8d17bde-576e-4a19-9d27-23dea58e9c94 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4.info is being set with open permissions: ugo+rw Apr 16 19:42:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a8d17bde-576e-4a19-9d27-23dea58e9c94 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:09 devstack sudo[84960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4.info Apr 16 19:42:09 devstack sudo[84960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:10 devstack sudo[84960]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a8d17bde-576e-4a19-9d27-23dea58e9c94 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4.info" returned: 0 in 0.872s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a8d17bde-576e-4a19-9d27-23dea58e9c94 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.890s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:42:10 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-a8d17bde-576e-4a19-9d27-23dea58e9c94 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Create snapshot completed successfully Apr 16 19:42:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c41c0f59-c691-49d9-8821-dea99e8697ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Acquiring lock "cinder-be8ea65f-ff06-4c66-a0e0-24ccaa1cb753-delete_snapshot" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:42:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c41c0f59-c691-49d9-8821-dea99e8697ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Lock "cinder-be8ea65f-ff06-4c66-a0e0-24ccaa1cb753-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:42:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c41c0f59-c691-49d9-8821-dea99e8697ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Acquiring lock "cinder-quobyte-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:42:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c41c0f59-c691-49d9-8821-dea99e8697ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Lock "cinder-quobyte-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4" acquired by "delete_snapshot" :: waited 0.031s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:42:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c41c0f59-c691-49d9-8821-dea99e8697ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Acquiring lock "cinder-quobyte-be8ea65f-ff06-4c66-a0e0-24ccaa1cb753" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:42:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c41c0f59-c691-49d9-8821-dea99e8697ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Lock "cinder-quobyte-be8ea65f-ff06-4c66-a0e0-24ccaa1cb753" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:42:11 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-c41c0f59-c691-49d9-8821-dea99e8697ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Deleting offline snapshot be8ea65f-ff06-4c66-a0e0-24ccaa1cb753 of volume f54d0da7-68aa-4fde-b395-9ff9a4fad4b4 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:42:11 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-c41c0f59-c691-49d9-8821-dea99e8697ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] snapshot_file for this snap is: volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4.be8ea65f-ff06-4c66-a0e0-24ccaa1cb753 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:42:11 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfdefd9-5e1b-4545-bdd1-7056044a7bc4]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:42:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c41c0f59-c691-49d9-8821-dea99e8697ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4.be8ea65f-ff06-4c66-a0e0-24ccaa1cb753 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:11 devstack sudo[85002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4.be8ea65f-ff06-4c66-a0e0-24ccaa1cb753 Apr 16 19:42:11 devstack sudo[85002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-6414eb86-fc56-4a60-b9b2-04353d04a497 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:42:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-6414eb86-fc56-4a60-b9b2-04353d04a497 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:42:12 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f372699-c575-49f8-bc93-6a3d35cfeb68]: (4, 'raw') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:42:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-6414eb86-fc56-4a60-b9b2-04353d04a497 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:12 devstack sudo[85014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859 Apr 16 19:42:12 devstack sudo[85014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:12 devstack sudo[85002]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c41c0f59-c691-49d9-8821-dea99e8697ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4.be8ea65f-ff06-4c66-a0e0-24ccaa1cb753" returned: 0 in 0.763s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:12 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-c41c0f59-c691-49d9-8821-dea99e8697ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:42:12 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[259033ce-d678-430a-a1e3-0200743e6bc2]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:42:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c41c0f59-c691-49d9-8821-dea99e8697ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:12 devstack sudo[85029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4 Apr 16 19:42:12 devstack sudo[85029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:12 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:42:12 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Flow 'volume_create_manager' (61d613ae-898f-42d7-b603-7fe013dc6233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:42:12 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba1f7c3-8dc0-4aa7-86ee-77996aaf3435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:12 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba1f7c3-8dc0-4aa7-86ee-77996aaf3435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1681041371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c35530ce-dd07-4c9b-afa2-5edfa7ac7849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85524b8d1022403c8761837df99e152e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:42:13Z,use_quota=True,user_id='1a3c8d679688472b907e64a107efc48d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:12 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc12b83b-0f4f-45a4-be3e-b6964edfc12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:12 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc12b83b-0f4f-45a4-be3e-b6964edfc12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:12 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a093a91b-9748-41e6-9621-f7a6799c725a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:12 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a093a91b-9748-41e6-9621-f7a6799c725a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c35530ce-dd07-4c9b-afa2-5edfa7ac7849', 'volume_name': 'volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:12 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f7a58d-a446-42d3-82f2-b105c2fc9485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:12 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f7a58d-a446-42d3-82f2-b105c2fc9485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:12 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1f7392-ee6b-417f-83a6-128eca1fc095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:12 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Volume c35530ce-dd07-4c9b-afa2-5edfa7ac7849: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849', 'volume_size': 1} Apr 16 19:42:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:42:12 devstack sudo[85014]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-6414eb86-fc56-4a60-b9b2-04353d04a497 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859" returned: 0 in 0.796s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-6414eb86-fc56-4a60-b9b2-04353d04a497 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:12 devstack sudo[85033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859 Apr 16 19:42:12 devstack sudo[85033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:13 devstack sudo[85029]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c41c0f59-c691-49d9-8821-dea99e8697ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4" returned: 0 in 0.718s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c41c0f59-c691-49d9-8821-dea99e8697ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4.be8ea65f-ff06-4c66-a0e0-24ccaa1cb753 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:13 devstack sudo[85038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4.be8ea65f-ff06-4c66-a0e0-24ccaa1cb753 Apr 16 19:42:13 devstack sudo[85038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:13 devstack sudo[85033]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-6414eb86-fc56-4a60-b9b2-04353d04a497 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859" returned: 1 in 0.624s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-6414eb86-fc56-4a60-b9b2-04353d04a497 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859' failed. Not Retrying. {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 19:42:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-6414eb86-fc56-4a60-b9b2-04353d04a497 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.480s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:42:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.716s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:42:13 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1681041371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c35530ce-dd07-4c9b-afa2-5edfa7ac7849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85524b8d1022403c8761837df99e152e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:42:13Z,use_quota=True,user_id='1a3c8d679688472b907e64a107efc48d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:42:13 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Creating volume c35530ce-dd07-4c9b-afa2-5edfa7ac7849 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:42:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:42:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:42:13 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:42:13 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:42:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:42:13 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:42:13 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:42:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:13 devstack sudo[85044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849 1073741824 Apr 16 19:42:13 devstack sudo[85044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-6414eb86-fc56-4a60-b9b2-04353d04a497 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c', 'name': 'volume-ce1e2e6a-535f-4105-a70c-97911979c859', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '689547b9-eab1-411f-9bb2-5d78e2a05242', 'enforce_multipath': True} {{(pid=82569) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 16 19:42:13 devstack cinder-volume[82569]: INFO cinder.volume.manager [req-9416bc7b-cb17-481a-bc76-f1a7cefedd1b req-6414eb86-fc56-4a60-b9b2-04353d04a497 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] attachment_update completed successfully. Apr 16 19:42:13 devstack sudo[85038]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c41c0f59-c691-49d9-8821-dea99e8697ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4.be8ea65f-ff06-4c66-a0e0-24ccaa1cb753" returned: 0 in 0.672s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c41c0f59-c691-49d9-8821-dea99e8697ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4.be8ea65f-ff06-4c66-a0e0-24ccaa1cb753 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:13 devstack sudo[85049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4.be8ea65f-ff06-4c66-a0e0-24ccaa1cb753 Apr 16 19:42:13 devstack sudo[85049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:14 devstack sudo[85044]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849 1073741824" returned: 0 in 0.796s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:14 devstack sudo[85066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849 Apr 16 19:42:14 devstack sudo[85066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:14 devstack sudo[85049]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c41c0f59-c691-49d9-8821-dea99e8697ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4.be8ea65f-ff06-4c66-a0e0-24ccaa1cb753" returned: 0 in 0.615s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:14 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c41c0f59-c691-49d9-8821-dea99e8697ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Lock "cinder-quobyte-be8ea65f-ff06-4c66-a0e0-24ccaa1cb753" released by "_delete_snapshot" :: held 2.872s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:42:14 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c41c0f59-c691-49d9-8821-dea99e8697ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Lock "cinder-quobyte-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4" released by "delete_snapshot" :: held 2.905s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:42:14 devstack cinder-volume[82569]: WARNING cinder.quota [None req-c41c0f59-c691-49d9-8821-dea99e8697ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 16 19:42:14 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-c41c0f59-c691-49d9-8821-dea99e8697ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Created reservations ['269618dd-9c20-49c9-9309-65da1c75dd1b', 'ce86dc8e-af66-4afe-a94a-327fbb40f5dc', '1de9bf07-028e-424c-b4d2-3bdaead561cf', '253ab994-569a-43ad-aa0b-bbec2d92599f'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:42:14 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-c41c0f59-c691-49d9-8821-dea99e8697ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Delete snapshot completed successfully. Apr 16 19:42:14 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c41c0f59-c691-49d9-8821-dea99e8697ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Lock "cinder-be8ea65f-ff06-4c66-a0e0-24ccaa1cb753-delete_snapshot" released by "delete_snapshot" :: held 3.075s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:42:14 devstack sudo[85066]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849" returned: 0 in 0.539s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:42:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:42:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1f7392-ee6b-417f-83a6-128eca1fc095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d508e82a-8fd8-4fb9-8dc0-6cc8e69cc52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:14 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Volume volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849 (c35530ce-dd07-4c9b-afa2-5edfa7ac7849): created successfully Apr 16 19:42:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d508e82a-8fd8-4fb9-8dc0-6cc8e69cc52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Flow 'volume_create_manager' (61d613ae-898f-42d7-b603-7fe013dc6233) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:42:14 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-aae6e19d-e445-4f84-916c-66bd78672109 tempest-SnapshotsActionsTest-1458040281 None] Created volume successfully. Apr 16 19:42:14 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e24cf4a4-89ef-4878-ba43-a51d219abd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Acquiring lock "cinder-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:42:14 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e24cf4a4-89ef-4878-ba43-a51d219abd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Lock "cinder-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:42:15 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e24cf4a4-89ef-4878-ba43-a51d219abd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Acquiring lock "cinder-quobyte-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:42:15 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e24cf4a4-89ef-4878-ba43-a51d219abd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Lock "cinder-quobyte-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4" acquired by "delete_volume" :: waited 0.023s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:42:15 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3be7aa-3767-42bb-9121-d4bdbf401bd6]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:42:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e24cf4a4-89ef-4878-ba43-a51d219abd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:15 devstack sudo[85075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4 Apr 16 19:42:15 devstack sudo[85075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:15 devstack sudo[85075]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e24cf4a4-89ef-4878-ba43-a51d219abd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4" returned: 0 in 0.587s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e24cf4a4-89ef-4878-ba43-a51d219abd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:15 devstack sudo[85083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4 Apr 16 19:42:15 devstack sudo[85083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d140026f-a64d-4977-b2e0-441aad569c61 tempest-SnapshotsActionsTest-1458040281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:42:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d140026f-a64d-4977-b2e0-441aad569c61 tempest-SnapshotsActionsTest-1458040281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:42:16 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-d140026f-a64d-4977-b2e0-441aad569c61 tempest-SnapshotsActionsTest-1458040281 None] Creating offline snapshot ccdbab62-035d-4273-8bb6-f120e2457597 of volume c35530ce-dd07-4c9b-afa2-5edfa7ac7849 {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:42:16 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a14037-c826-48c9-b8b7-0a2f308cd3c8]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:42:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d140026f-a64d-4977-b2e0-441aad569c61 tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:16 devstack sudo[85086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849 Apr 16 19:42:16 devstack sudo[85086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:16 devstack sudo[85083]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e24cf4a4-89ef-4878-ba43-a51d219abd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4" returned: 0 in 0.615s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:16 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e24cf4a4-89ef-4878-ba43-a51d219abd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Lock "cinder-quobyte-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4" released by "delete_volume" :: held 1.245s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:42:16 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-e24cf4a4-89ef-4878-ba43-a51d219abd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Created reservations ['9c54436e-f40c-41c3-b96d-dad41fe0cba6', 'a8d1ee2b-6af8-4b86-a0f7-b7c87a15367b', '92ac8754-6d3e-4ae8-ab24-b702f2cbfb9b', 'e49571d9-1de6-4fa8-8359-e759a256560f'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:42:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e24cf4a4-89ef-4878-ba43-a51d219abd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:42:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e24cf4a4-89ef-4878-ba43-a51d219abd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:42:16 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e24cf4a4-89ef-4878-ba43-a51d219abd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:42:16 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e24cf4a4-89ef-4878-ba43-a51d219abd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:42:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e24cf4a4-89ef-4878-ba43-a51d219abd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:42:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e24cf4a4-89ef-4878-ba43-a51d219abd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:16 devstack sudo[85088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:42:16 devstack sudo[85088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:16 devstack sudo[85086]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d140026f-a64d-4977-b2e0-441aad569c61 tempest-SnapshotsActionsTest-1458040281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849" returned: 0 in 0.651s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d140026f-a64d-4977-b2e0-441aad569c61 tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:16 devstack sudo[85100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 1G Apr 16 19:42:16 devstack sudo[85100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:16 devstack sudo[85088]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e24cf4a4-89ef-4878-ba43-a51d219abd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.502s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:16 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-e24cf4a4-89ef-4878-ba43-a51d219abd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:42:16 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-e24cf4a4-89ef-4878-ba43-a51d219abd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Deleted volume successfully. Apr 16 19:42:16 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e24cf4a4-89ef-4878-ba43-a51d219abd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2048843326 None] Lock "cinder-f54d0da7-68aa-4fde-b395-9ff9a4fad4b4-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:42:17 devstack sudo[85100]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d140026f-a64d-4977-b2e0-441aad569c61 tempest-SnapshotsActionsTest-1458040281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 1G" returned: 0 in 0.864s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d140026f-a64d-4977-b2e0-441aad569c61 tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:17 devstack sudo[85147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 Apr 16 19:42:17 devstack sudo[85147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:18 devstack sudo[85147]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d140026f-a64d-4977-b2e0-441aad569c61 tempest-SnapshotsActionsTest-1458040281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597" returned: 0 in 0.717s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:18 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-d140026f-a64d-4977-b2e0-441aad569c61 tempest-SnapshotsActionsTest-1458040281 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 is being set with open permissions: ugo+rw Apr 16 19:42:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d140026f-a64d-4977-b2e0-441aad569c61 tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:18 devstack sudo[85175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 Apr 16 19:42:18 devstack sudo[85175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:19 devstack sudo[85175]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d140026f-a64d-4977-b2e0-441aad569c61 tempest-SnapshotsActionsTest-1458040281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597" returned: 0 in 1.336s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d140026f-a64d-4977-b2e0-441aad569c61 tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:19 devstack sudo[85215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.info Apr 16 19:42:19 devstack sudo[85215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:20 devstack sudo[85215]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d140026f-a64d-4977-b2e0-441aad569c61 tempest-SnapshotsActionsTest-1458040281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.info" returned: 0 in 0.806s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:20 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-d140026f-a64d-4977-b2e0-441aad569c61 tempest-SnapshotsActionsTest-1458040281 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.info is being set with open permissions: ugo+rw Apr 16 19:42:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d140026f-a64d-4977-b2e0-441aad569c61 tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:20 devstack sudo[85220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.info Apr 16 19:42:20 devstack sudo[85220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:21 devstack sudo[85220]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d140026f-a64d-4977-b2e0-441aad569c61 tempest-SnapshotsActionsTest-1458040281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.info" returned: 0 in 1.074s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d140026f-a64d-4977-b2e0-441aad569c61 tempest-SnapshotsActionsTest-1458040281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.626s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:42:21 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-d140026f-a64d-4977-b2e0-441aad569c61 tempest-SnapshotsActionsTest-1458040281 None] Create snapshot completed successfully Apr 16 19:42:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2b902564-57ae-4151-b5dc-54c09d63185c tempest-SnapshotsActionsTest-1458040281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:42:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2b902564-57ae-4151-b5dc-54c09d63185c tempest-SnapshotsActionsTest-1458040281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:42:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-2b902564-57ae-4151-b5dc-54c09d63185c tempest-SnapshotsActionsTest-1458040281 None] Creating offline snapshot b2b38be0-dd5b-4db8-9638-542f6cd64b16 of volume c35530ce-dd07-4c9b-afa2-5edfa7ac7849 {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:42:24 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2c6ca1-9f7e-4c91-aee3-71c858a66ee2]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:42:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2b902564-57ae-4151-b5dc-54c09d63185c tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:24 devstack sudo[85229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 Apr 16 19:42:24 devstack sudo[85229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:25 devstack sudo[85229]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2b902564-57ae-4151-b5dc-54c09d63185c tempest-SnapshotsActionsTest-1458040281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597" returned: 0 in 1.305s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:25 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-2b902564-57ae-4151-b5dc-54c09d63185c tempest-SnapshotsActionsTest-1458040281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:42:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2b902564-57ae-4151-b5dc-54c09d63185c tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.b2b38be0-dd5b-4db8-9638-542f6cd64b16 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:25 devstack sudo[85235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.b2b38be0-dd5b-4db8-9638-542f6cd64b16 1G Apr 16 19:42:25 devstack sudo[85235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:26 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:42:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Flow 'volume_create_manager' (2a3db641-5f36-4771-83e6-02e542307bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:42:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb9702f-fc34-4ec1-84c0-16bc1366ac3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb9702f-fc34-4ec1-84c0-16bc1366ac3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-950419772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a67aedf-0298-4d57-a614-aa6ef91545cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7196865490dc4bc0a7ee5296fae2e1e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:42:27Z,use_quota=True,user_id='d967a30dd9554580aca68be6c8f7d318',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9b20925-e0f1-4547-896d-845ef7d9805c),volume_type_id=f9b20925-e0f1-4547-896d-845ef7d9805c)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b8b7c9-2371-4445-a1b9-57c1342d4f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b8b7c9-2371-4445-a1b9-57c1342d4f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (130389bb-5e67-4d59-a933-4b1dc61a71c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (130389bb-5e67-4d59-a933-4b1dc61a71c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a67aedf-0298-4d57-a614-aa6ef91545cd', 'volume_name': 'volume-6a67aedf-0298-4d57-a614-aa6ef91545cd', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4cc652-61ce-427a-b096-3d86ca20a9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4cc652-61ce-427a-b096-3d86ca20a9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a802b0c-5af2-429b-828a-30d99e2cc489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:26 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Volume 6a67aedf-0298-4d57-a614-aa6ef91545cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a67aedf-0298-4d57-a614-aa6ef91545cd', 'volume_size': 1} Apr 16 19:42:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:42:26 devstack sudo[85235]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2b902564-57ae-4151-b5dc-54c09d63185c tempest-SnapshotsActionsTest-1458040281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.b2b38be0-dd5b-4db8-9638-542f6cd64b16 1G" returned: 0 in 1.570s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2b902564-57ae-4151-b5dc-54c09d63185c tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.b2b38be0-dd5b-4db8-9638-542f6cd64b16 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:27 devstack sudo[85240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.b2b38be0-dd5b-4db8-9638-542f6cd64b16 Apr 16 19:42:27 devstack sudo[85240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:27 devstack sudo[85240]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2b902564-57ae-4151-b5dc-54c09d63185c tempest-SnapshotsActionsTest-1458040281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.b2b38be0-dd5b-4db8-9638-542f6cd64b16" returned: 0 in 0.631s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:27 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-2b902564-57ae-4151-b5dc-54c09d63185c tempest-SnapshotsActionsTest-1458040281 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.b2b38be0-dd5b-4db8-9638-542f6cd64b16 is being set with open permissions: ugo+rw Apr 16 19:42:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2b902564-57ae-4151-b5dc-54c09d63185c tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.b2b38be0-dd5b-4db8-9638-542f6cd64b16 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:27 devstack sudo[85245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.b2b38be0-dd5b-4db8-9638-542f6cd64b16 Apr 16 19:42:27 devstack sudo[85245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:28 devstack sudo[85245]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2b902564-57ae-4151-b5dc-54c09d63185c tempest-SnapshotsActionsTest-1458040281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.b2b38be0-dd5b-4db8-9638-542f6cd64b16" returned: 0 in 0.643s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2b902564-57ae-4151-b5dc-54c09d63185c tempest-SnapshotsActionsTest-1458040281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.451s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:42:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.492s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:42:28 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-950419772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a67aedf-0298-4d57-a614-aa6ef91545cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7196865490dc4bc0a7ee5296fae2e1e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:42:27Z,use_quota=True,user_id='d967a30dd9554580aca68be6c8f7d318',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9b20925-e0f1-4547-896d-845ef7d9805c),volume_type_id=f9b20925-e0f1-4547-896d-845ef7d9805c)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:42:28 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Creating volume 6a67aedf-0298-4d57-a614-aa6ef91545cd {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:42:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:42:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:42:28 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:42:28 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:42:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:42:28 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:42:28 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:42:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6a67aedf-0298-4d57-a614-aa6ef91545cd 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:28 devstack sudo[85272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6a67aedf-0298-4d57-a614-aa6ef91545cd 1073741824 Apr 16 19:42:28 devstack sudo[85272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:28 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-2b902564-57ae-4151-b5dc-54c09d63185c tempest-SnapshotsActionsTest-1458040281 None] Create snapshot completed successfully Apr 16 19:42:29 devstack sudo[85272]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6a67aedf-0298-4d57-a614-aa6ef91545cd 1073741824" returned: 0 in 0.791s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6a67aedf-0298-4d57-a614-aa6ef91545cd {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:29 devstack sudo[85310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6a67aedf-0298-4d57-a614-aa6ef91545cd Apr 16 19:42:29 devstack sudo[85310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:29 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e5f69b03-25a9-42e0-8a64-4b3dae04c381 tempest-SnapshotsActionsTest-1792954453 None] Acquiring lock "cinder-b2b38be0-dd5b-4db8-9638-542f6cd64b16-delete_snapshot" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:42:29 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e5f69b03-25a9-42e0-8a64-4b3dae04c381 tempest-SnapshotsActionsTest-1792954453 None] Lock "cinder-b2b38be0-dd5b-4db8-9638-542f6cd64b16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:42:29 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e5f69b03-25a9-42e0-8a64-4b3dae04c381 tempest-SnapshotsActionsTest-1792954453 None] Acquiring lock "cinder-quobyte-c35530ce-dd07-4c9b-afa2-5edfa7ac7849" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:42:29 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e5f69b03-25a9-42e0-8a64-4b3dae04c381 tempest-SnapshotsActionsTest-1792954453 None] Lock "cinder-quobyte-c35530ce-dd07-4c9b-afa2-5edfa7ac7849" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:42:29 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e5f69b03-25a9-42e0-8a64-4b3dae04c381 tempest-SnapshotsActionsTest-1792954453 None] Acquiring lock "cinder-quobyte-b2b38be0-dd5b-4db8-9638-542f6cd64b16" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:42:29 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e5f69b03-25a9-42e0-8a64-4b3dae04c381 tempest-SnapshotsActionsTest-1792954453 None] Lock "cinder-quobyte-b2b38be0-dd5b-4db8-9638-542f6cd64b16" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:42:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-e5f69b03-25a9-42e0-8a64-4b3dae04c381 tempest-SnapshotsActionsTest-1792954453 None] Deleting offline snapshot b2b38be0-dd5b-4db8-9638-542f6cd64b16 of volume c35530ce-dd07-4c9b-afa2-5edfa7ac7849 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:42:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-e5f69b03-25a9-42e0-8a64-4b3dae04c381 tempest-SnapshotsActionsTest-1792954453 None] snapshot_file for this snap is: volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.b2b38be0-dd5b-4db8-9638-542f6cd64b16 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:42:29 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[da662e9a-077f-40f7-9206-59393daebb37]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:42:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e5f69b03-25a9-42e0-8a64-4b3dae04c381 tempest-SnapshotsActionsTest-1792954453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.b2b38be0-dd5b-4db8-9638-542f6cd64b16 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:29 devstack sudo[85312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.b2b38be0-dd5b-4db8-9638-542f6cd64b16 Apr 16 19:42:29 devstack sudo[85312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:29 devstack sudo[85310]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6a67aedf-0298-4d57-a614-aa6ef91545cd" returned: 0 in 0.698s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:42:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:42:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a802b0c-5af2-429b-828a-30d99e2cc489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a67aedf-0298-4d57-a614-aa6ef91545cd', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6abb8ea2-e924-4023-bb00-1f4145d2d2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:29 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Volume volume-6a67aedf-0298-4d57-a614-aa6ef91545cd (6a67aedf-0298-4d57-a614-aa6ef91545cd): created successfully Apr 16 19:42:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6abb8ea2-e924-4023-bb00-1f4145d2d2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Flow 'volume_create_manager' (2a3db641-5f36-4771-83e6-02e542307bec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:42:29 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-0bd44f8e-dddf-4a75-aafc-2636cdcdab94 tempest-VolumeTypesAccessTest-414126528 None] Created volume successfully. Apr 16 19:42:30 devstack sudo[85312]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e5f69b03-25a9-42e0-8a64-4b3dae04c381 tempest-SnapshotsActionsTest-1792954453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.b2b38be0-dd5b-4db8-9638-542f6cd64b16" returned: 0 in 0.775s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-e5f69b03-25a9-42e0-8a64-4b3dae04c381 tempest-SnapshotsActionsTest-1792954453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:42:30 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcd8ff4-9359-4563-a81b-34901c88003c]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:42:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e5f69b03-25a9-42e0-8a64-4b3dae04c381 tempest-SnapshotsActionsTest-1792954453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:30 devstack sudo[85337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 Apr 16 19:42:30 devstack sudo[85337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:30 devstack sudo[85337]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e5f69b03-25a9-42e0-8a64-4b3dae04c381 tempest-SnapshotsActionsTest-1792954453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597" returned: 0 in 0.545s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-e5f69b03-25a9-42e0-8a64-4b3dae04c381 tempest-SnapshotsActionsTest-1792954453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:42:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e5f69b03-25a9-42e0-8a64-4b3dae04c381 tempest-SnapshotsActionsTest-1792954453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.b2b38be0-dd5b-4db8-9638-542f6cd64b16 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:30 devstack sudo[85348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.b2b38be0-dd5b-4db8-9638-542f6cd64b16 Apr 16 19:42:30 devstack sudo[85348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:31 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-94a6fc8d-461d-4f9d-a4a5-8a30676b8ac5 tempest-VolumeTypesAccessTest-414126528 None] Acquiring lock "cinder-6a67aedf-0298-4d57-a614-aa6ef91545cd-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:42:31 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-94a6fc8d-461d-4f9d-a4a5-8a30676b8ac5 tempest-VolumeTypesAccessTest-414126528 None] Lock "cinder-6a67aedf-0298-4d57-a614-aa6ef91545cd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:42:31 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-94a6fc8d-461d-4f9d-a4a5-8a30676b8ac5 tempest-VolumeTypesAccessTest-414126528 None] Acquiring lock "cinder-quobyte-6a67aedf-0298-4d57-a614-aa6ef91545cd" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:42:31 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-94a6fc8d-461d-4f9d-a4a5-8a30676b8ac5 tempest-VolumeTypesAccessTest-414126528 None] Lock "cinder-quobyte-6a67aedf-0298-4d57-a614-aa6ef91545cd" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:42:31 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[554c745d-2bd5-4816-bdff-d52a2a8b47bb]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:42:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-94a6fc8d-461d-4f9d-a4a5-8a30676b8ac5 tempest-VolumeTypesAccessTest-414126528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6a67aedf-0298-4d57-a614-aa6ef91545cd {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:31 devstack sudo[85353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6a67aedf-0298-4d57-a614-aa6ef91545cd Apr 16 19:42:31 devstack sudo[85353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:31 devstack sudo[85348]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e5f69b03-25a9-42e0-8a64-4b3dae04c381 tempest-SnapshotsActionsTest-1792954453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.b2b38be0-dd5b-4db8-9638-542f6cd64b16" returned: 0 in 0.711s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e5f69b03-25a9-42e0-8a64-4b3dae04c381 tempest-SnapshotsActionsTest-1792954453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.b2b38be0-dd5b-4db8-9638-542f6cd64b16 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:31 devstack sudo[85355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.b2b38be0-dd5b-4db8-9638-542f6cd64b16 Apr 16 19:42:31 devstack sudo[85355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:31 devstack sudo[85353]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-94a6fc8d-461d-4f9d-a4a5-8a30676b8ac5 tempest-VolumeTypesAccessTest-414126528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6a67aedf-0298-4d57-a614-aa6ef91545cd" returned: 0 in 0.682s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-94a6fc8d-461d-4f9d-a4a5-8a30676b8ac5 tempest-VolumeTypesAccessTest-414126528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6a67aedf-0298-4d57-a614-aa6ef91545cd {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:31 devstack sudo[85355]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e5f69b03-25a9-42e0-8a64-4b3dae04c381 tempest-SnapshotsActionsTest-1792954453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.b2b38be0-dd5b-4db8-9638-542f6cd64b16" returned: 0 in 0.568s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:31 devstack sudo[85362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6a67aedf-0298-4d57-a614-aa6ef91545cd Apr 16 19:42:31 devstack sudo[85362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:31 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e5f69b03-25a9-42e0-8a64-4b3dae04c381 tempest-SnapshotsActionsTest-1792954453 None] Lock "cinder-quobyte-b2b38be0-dd5b-4db8-9638-542f6cd64b16" released by "_delete_snapshot" :: held 2.677s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:42:32 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e5f69b03-25a9-42e0-8a64-4b3dae04c381 tempest-SnapshotsActionsTest-1792954453 None] Lock "cinder-quobyte-c35530ce-dd07-4c9b-afa2-5edfa7ac7849" released by "delete_snapshot" :: held 2.701s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:42:32 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-e5f69b03-25a9-42e0-8a64-4b3dae04c381 tempest-SnapshotsActionsTest-1792954453 None] Created reservations ['26d4eb3f-682d-468b-9113-50d2b3e9b077', 'a4af06e9-d6c3-4db4-b469-c26b0558e445', '40366a84-931c-4eb3-8c6a-f039d996a462', 'f9a4ab6f-6ad0-4041-9988-4b952c09104b'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:42:32 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-e5f69b03-25a9-42e0-8a64-4b3dae04c381 tempest-SnapshotsActionsTest-1792954453 None] Delete snapshot completed successfully. Apr 16 19:42:32 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e5f69b03-25a9-42e0-8a64-4b3dae04c381 tempest-SnapshotsActionsTest-1792954453 None] Lock "cinder-b2b38be0-dd5b-4db8-9638-542f6cd64b16-delete_snapshot" released by "delete_snapshot" :: held 2.840s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:42:32 devstack sudo[85362]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-94a6fc8d-461d-4f9d-a4a5-8a30676b8ac5 tempest-VolumeTypesAccessTest-414126528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6a67aedf-0298-4d57-a614-aa6ef91545cd" returned: 0 in 0.545s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:32 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-94a6fc8d-461d-4f9d-a4a5-8a30676b8ac5 tempest-VolumeTypesAccessTest-414126528 None] Lock "cinder-quobyte-6a67aedf-0298-4d57-a614-aa6ef91545cd" released by "delete_volume" :: held 1.262s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:42:32 devstack cinder-volume[82569]: WARNING cinder.quota [None req-94a6fc8d-461d-4f9d-a4a5-8a30676b8ac5 tempest-VolumeTypesAccessTest-414126528 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-252318331 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-252318331, it is now deprecated. Please use the default quota class for default quota. Apr 16 19:42:32 devstack cinder-volume[82569]: WARNING cinder.quota [None req-94a6fc8d-461d-4f9d-a4a5-8a30676b8ac5 tempest-VolumeTypesAccessTest-414126528 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-252318331 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-252318331, it is now deprecated. Please use the default quota class for default quota. Apr 16 19:42:32 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-94a6fc8d-461d-4f9d-a4a5-8a30676b8ac5 tempest-VolumeTypesAccessTest-414126528 None] Created reservations ['6c6bb963-2548-42f3-9c98-a46f76d76797', 'b0a4a86d-2bb4-462b-bab7-a7d2954f4533', '3f390ac1-5cff-40a3-94ad-970809fd4f48', 'eda03bb1-11f3-474e-85bd-22d067b9e9f4'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:42:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-94a6fc8d-461d-4f9d-a4a5-8a30676b8ac5 tempest-VolumeTypesAccessTest-414126528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:42:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-94a6fc8d-461d-4f9d-a4a5-8a30676b8ac5 tempest-VolumeTypesAccessTest-414126528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:42:32 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-94a6fc8d-461d-4f9d-a4a5-8a30676b8ac5 tempest-VolumeTypesAccessTest-414126528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:42:32 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-94a6fc8d-461d-4f9d-a4a5-8a30676b8ac5 tempest-VolumeTypesAccessTest-414126528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:42:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-94a6fc8d-461d-4f9d-a4a5-8a30676b8ac5 tempest-VolumeTypesAccessTest-414126528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:42:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-94a6fc8d-461d-4f9d-a4a5-8a30676b8ac5 tempest-VolumeTypesAccessTest-414126528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:32 devstack sudo[85366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:42:32 devstack sudo[85366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a7b98760-14c8-4357-b2ad-b6759afa3b76 tempest-SnapshotsActionsTest-1458040281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:42:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a7b98760-14c8-4357-b2ad-b6759afa3b76 tempest-SnapshotsActionsTest-1458040281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:42:32 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-a7b98760-14c8-4357-b2ad-b6759afa3b76 tempest-SnapshotsActionsTest-1458040281 None] Creating offline snapshot a3347994-91a6-415d-aa53-8b378448bc31 of volume c35530ce-dd07-4c9b-afa2-5edfa7ac7849 {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:42:32 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ac70cf-7b80-44c0-94ec-282a688dfed8]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:42:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a7b98760-14c8-4357-b2ad-b6759afa3b76 tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:32 devstack sudo[85368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 Apr 16 19:42:32 devstack sudo[85368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:33 devstack sudo[85366]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-94a6fc8d-461d-4f9d-a4a5-8a30676b8ac5 tempest-VolumeTypesAccessTest-414126528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.505s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:33 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-94a6fc8d-461d-4f9d-a4a5-8a30676b8ac5 tempest-VolumeTypesAccessTest-414126528 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:42:33 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-94a6fc8d-461d-4f9d-a4a5-8a30676b8ac5 tempest-VolumeTypesAccessTest-414126528 None] Deleted volume successfully. Apr 16 19:42:33 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-94a6fc8d-461d-4f9d-a4a5-8a30676b8ac5 tempest-VolumeTypesAccessTest-414126528 None] Lock "cinder-6a67aedf-0298-4d57-a614-aa6ef91545cd-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:42:33 devstack sudo[85368]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a7b98760-14c8-4357-b2ad-b6759afa3b76 tempest-SnapshotsActionsTest-1458040281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597" returned: 0 in 0.603s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:33 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-a7b98760-14c8-4357-b2ad-b6759afa3b76 tempest-SnapshotsActionsTest-1458040281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:42:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a7b98760-14c8-4357-b2ad-b6759afa3b76 tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.a3347994-91a6-415d-aa53-8b378448bc31 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:33 devstack sudo[85376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.a3347994-91a6-415d-aa53-8b378448bc31 1G Apr 16 19:42:33 devstack sudo[85376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:34 devstack sudo[85376]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a7b98760-14c8-4357-b2ad-b6759afa3b76 tempest-SnapshotsActionsTest-1458040281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.a3347994-91a6-415d-aa53-8b378448bc31 1G" returned: 0 in 1.185s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a7b98760-14c8-4357-b2ad-b6759afa3b76 tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.a3347994-91a6-415d-aa53-8b378448bc31 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:34 devstack sudo[85433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.a3347994-91a6-415d-aa53-8b378448bc31 Apr 16 19:42:34 devstack sudo[85433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:35 devstack sudo[85433]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a7b98760-14c8-4357-b2ad-b6759afa3b76 tempest-SnapshotsActionsTest-1458040281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.a3347994-91a6-415d-aa53-8b378448bc31" returned: 0 in 1.438s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:35 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-a7b98760-14c8-4357-b2ad-b6759afa3b76 tempest-SnapshotsActionsTest-1458040281 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.a3347994-91a6-415d-aa53-8b378448bc31 is being set with open permissions: ugo+rw Apr 16 19:42:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a7b98760-14c8-4357-b2ad-b6759afa3b76 tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.a3347994-91a6-415d-aa53-8b378448bc31 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:36 devstack sudo[85447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.a3347994-91a6-415d-aa53-8b378448bc31 Apr 16 19:42:36 devstack sudo[85447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:36 devstack sudo[85447]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a7b98760-14c8-4357-b2ad-b6759afa3b76 tempest-SnapshotsActionsTest-1458040281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.a3347994-91a6-415d-aa53-8b378448bc31" returned: 0 in 0.884s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a7b98760-14c8-4357-b2ad-b6759afa3b76 tempest-SnapshotsActionsTest-1458040281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.187s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:42:36 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-a7b98760-14c8-4357-b2ad-b6759afa3b76 tempest-SnapshotsActionsTest-1458040281 None] Create snapshot completed successfully Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c075288a-38f3-4a94-a8d1-9f87f86f04e7 tempest-SnapshotsActionsTest-1792954453 None] Acquiring lock "cinder-a3347994-91a6-415d-aa53-8b378448bc31-delete_snapshot" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c075288a-38f3-4a94-a8d1-9f87f86f04e7 tempest-SnapshotsActionsTest-1792954453 None] Lock "cinder-a3347994-91a6-415d-aa53-8b378448bc31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c075288a-38f3-4a94-a8d1-9f87f86f04e7 tempest-SnapshotsActionsTest-1792954453 None] Acquiring lock "cinder-quobyte-c35530ce-dd07-4c9b-afa2-5edfa7ac7849" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c075288a-38f3-4a94-a8d1-9f87f86f04e7 tempest-SnapshotsActionsTest-1792954453 None] Lock "cinder-quobyte-c35530ce-dd07-4c9b-afa2-5edfa7ac7849" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c075288a-38f3-4a94-a8d1-9f87f86f04e7 tempest-SnapshotsActionsTest-1792954453 None] Acquiring lock "cinder-quobyte-a3347994-91a6-415d-aa53-8b378448bc31" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c075288a-38f3-4a94-a8d1-9f87f86f04e7 tempest-SnapshotsActionsTest-1792954453 None] Lock "cinder-quobyte-a3347994-91a6-415d-aa53-8b378448bc31" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-c075288a-38f3-4a94-a8d1-9f87f86f04e7 tempest-SnapshotsActionsTest-1792954453 None] Deleting offline snapshot a3347994-91a6-415d-aa53-8b378448bc31 of volume c35530ce-dd07-4c9b-afa2-5edfa7ac7849 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-c075288a-38f3-4a94-a8d1-9f87f86f04e7 tempest-SnapshotsActionsTest-1792954453 None] snapshot_file for this snap is: volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.a3347994-91a6-415d-aa53-8b378448bc31 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8df429-6eff-45dd-a13d-3d0f5f0dd9fa]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c075288a-38f3-4a94-a8d1-9f87f86f04e7 tempest-SnapshotsActionsTest-1792954453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.a3347994-91a6-415d-aa53-8b378448bc31 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:37 devstack sudo[85453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.a3347994-91a6-415d-aa53-8b378448bc31 Apr 16 19:42:37 devstack sudo[85453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Flow 'volume_create_manager' (95c51781-ab12-4577-88b8-0161224b7dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c37a2e8-9db0-4433-b7c4-c6d2ae668fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c37a2e8-9db0-4433-b7c4-c6d2ae668fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1453188396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6dafb63-8842-41da-bbcc-8b7fc23d9984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0943d25dace34627af052ae7927a4b5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:42:38Z,use_quota=True,user_id='f1240d99e9b34f1aa25111a3f9db423b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f952c466-1f51-4af4-abff-7792e68ec97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f952c466-1f51-4af4-abff-7792e68ec97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f080ad3d-e0d1-4c22-beda-c174b47ffa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f080ad3d-e0d1-4c22-beda-c174b47ffa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6dafb63-8842-41da-bbcc-8b7fc23d9984', 'volume_name': 'volume-c6dafb63-8842-41da-bbcc-8b7fc23d9984', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6ec871-8921-484f-8e99-92a698b0745e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6ec871-8921-484f-8e99-92a698b0745e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48cecb50-ba2d-4e7e-92ac-69c7f29cca24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:37 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Volume c6dafb63-8842-41da-bbcc-8b7fc23d9984: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6dafb63-8842-41da-bbcc-8b7fc23d9984', 'volume_size': 1} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1453188396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6dafb63-8842-41da-bbcc-8b7fc23d9984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0943d25dace34627af052ae7927a4b5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:42:38Z,use_quota=True,user_id='f1240d99e9b34f1aa25111a3f9db423b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Creating volume c6dafb63-8842-41da-bbcc-8b7fc23d9984 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:42:37 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:42:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c6dafb63-8842-41da-bbcc-8b7fc23d9984 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:37 devstack sudo[85455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c6dafb63-8842-41da-bbcc-8b7fc23d9984 1073741824 Apr 16 19:42:37 devstack sudo[85455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:38 devstack sudo[85453]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c075288a-38f3-4a94-a8d1-9f87f86f04e7 tempest-SnapshotsActionsTest-1792954453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.a3347994-91a6-415d-aa53-8b378448bc31" returned: 0 in 1.304s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:38 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-c075288a-38f3-4a94-a8d1-9f87f86f04e7 tempest-SnapshotsActionsTest-1792954453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:42:38 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3dc8d9-a3e4-4864-b281-087272346228]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:42:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c075288a-38f3-4a94-a8d1-9f87f86f04e7 tempest-SnapshotsActionsTest-1792954453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:38 devstack sudo[85463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 Apr 16 19:42:38 devstack sudo[85463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:39 devstack sudo[85455]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c6dafb63-8842-41da-bbcc-8b7fc23d9984 1073741824" returned: 0 in 1.414s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c6dafb63-8842-41da-bbcc-8b7fc23d9984 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:39 devstack sudo[85465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c6dafb63-8842-41da-bbcc-8b7fc23d9984 Apr 16 19:42:39 devstack sudo[85465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:40 devstack sudo[85463]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c075288a-38f3-4a94-a8d1-9f87f86f04e7 tempest-SnapshotsActionsTest-1792954453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597" returned: 0 in 1.368s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-c075288a-38f3-4a94-a8d1-9f87f86f04e7 tempest-SnapshotsActionsTest-1792954453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:42:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c075288a-38f3-4a94-a8d1-9f87f86f04e7 tempest-SnapshotsActionsTest-1792954453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.a3347994-91a6-415d-aa53-8b378448bc31 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:40 devstack sudo[85470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.a3347994-91a6-415d-aa53-8b378448bc31 Apr 16 19:42:40 devstack sudo[85470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:40 devstack sudo[85465]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c6dafb63-8842-41da-bbcc-8b7fc23d9984" returned: 0 in 1.333s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] <== create_volume: return (2847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:42:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.855s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:42:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48cecb50-ba2d-4e7e-92ac-69c7f29cca24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6dafb63-8842-41da-bbcc-8b7fc23d9984', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ebe9bd1-206d-400d-901f-854fa85ef725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:40 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Volume volume-c6dafb63-8842-41da-bbcc-8b7fc23d9984 (c6dafb63-8842-41da-bbcc-8b7fc23d9984): created successfully Apr 16 19:42:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ebe9bd1-206d-400d-901f-854fa85ef725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Flow 'volume_create_manager' (95c51781-ab12-4577-88b8-0161224b7dd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:42:40 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-e824c40d-49b7-4159-ac67-53bc0b9f6cae tempest-ServerRescueNegativeTestJSON-1175012910 None] Created volume successfully. Apr 16 19:42:41 devstack sudo[85470]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c075288a-38f3-4a94-a8d1-9f87f86f04e7 tempest-SnapshotsActionsTest-1792954453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.a3347994-91a6-415d-aa53-8b378448bc31" returned: 0 in 1.347s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c075288a-38f3-4a94-a8d1-9f87f86f04e7 tempest-SnapshotsActionsTest-1792954453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.a3347994-91a6-415d-aa53-8b378448bc31 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:41 devstack sudo[85521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.a3347994-91a6-415d-aa53-8b378448bc31 Apr 16 19:42:41 devstack sudo[85521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:43 devstack sudo[85521]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c075288a-38f3-4a94-a8d1-9f87f86f04e7 tempest-SnapshotsActionsTest-1792954453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.a3347994-91a6-415d-aa53-8b378448bc31" returned: 0 in 1.721s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c075288a-38f3-4a94-a8d1-9f87f86f04e7 tempest-SnapshotsActionsTest-1792954453 None] Lock "cinder-quobyte-a3347994-91a6-415d-aa53-8b378448bc31" released by "_delete_snapshot" :: held 5.924s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:42:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c075288a-38f3-4a94-a8d1-9f87f86f04e7 tempest-SnapshotsActionsTest-1792954453 None] Lock "cinder-quobyte-c35530ce-dd07-4c9b-afa2-5edfa7ac7849" released by "delete_snapshot" :: held 5.951s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:42:43 devstack cinder-volume[82569]: DEBUG dbcounter [-] [82569] Writing DB stats cinder:UPDATE=98,cinder:SELECT=103,cinder:INSERT=38,cinder:DELETE=4 {{(pid=82569) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:42:43 devstack cinder-volume[82569]: DEBUG dbcounter [-] [82569] Writing DB stats cinder:UPDATE=110,cinder:SELECT=107,cinder:INSERT=26,cinder:DELETE=8 {{(pid=82569) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:42:43 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-c075288a-38f3-4a94-a8d1-9f87f86f04e7 tempest-SnapshotsActionsTest-1792954453 None] Created reservations ['699f07d4-6829-449a-b90b-66485abb8b48', '06a3dc16-474c-4950-ba16-c2376da2fc97', 'd1cfe25d-2155-4607-abdd-0c339db5fc8b', '6c72d4e1-b259-41fb-b377-6fda6f4aeb1b'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:42:43 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-c075288a-38f3-4a94-a8d1-9f87f86f04e7 tempest-SnapshotsActionsTest-1792954453 None] Delete snapshot completed successfully. Apr 16 19:42:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c075288a-38f3-4a94-a8d1-9f87f86f04e7 tempest-SnapshotsActionsTest-1792954453 None] Lock "cinder-a3347994-91a6-415d-aa53-8b378448bc31-delete_snapshot" released by "delete_snapshot" :: held 6.210s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:42:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5b86fc9c-b24c-4ad2-9d4e-70abbad27201 tempest-SnapshotsActionsTest-1458040281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:42:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5b86fc9c-b24c-4ad2-9d4e-70abbad27201 tempest-SnapshotsActionsTest-1458040281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:42:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-5b86fc9c-b24c-4ad2-9d4e-70abbad27201 tempest-SnapshotsActionsTest-1458040281 None] Creating offline snapshot 4013160f-b639-4436-9b17-204016a143a9 of volume c35530ce-dd07-4c9b-afa2-5edfa7ac7849 {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:42:44 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[b219befe-e484-4dac-ad63-1cd7a00b5b65]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:42:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5b86fc9c-b24c-4ad2-9d4e-70abbad27201 tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:44 devstack sudo[85535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 Apr 16 19:42:44 devstack sudo[85535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:45 devstack sudo[85535]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5b86fc9c-b24c-4ad2-9d4e-70abbad27201 tempest-SnapshotsActionsTest-1458040281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597" returned: 0 in 1.189s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:45 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-5b86fc9c-b24c-4ad2-9d4e-70abbad27201 tempest-SnapshotsActionsTest-1458040281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:42:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5b86fc9c-b24c-4ad2-9d4e-70abbad27201 tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.4013160f-b639-4436-9b17-204016a143a9 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:45 devstack sudo[85566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.4013160f-b639-4436-9b17-204016a143a9 1G Apr 16 19:42:45 devstack sudo[85566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:46 devstack sudo[85566]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5b86fc9c-b24c-4ad2-9d4e-70abbad27201 tempest-SnapshotsActionsTest-1458040281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.4013160f-b639-4436-9b17-204016a143a9 1G" returned: 0 in 0.996s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5b86fc9c-b24c-4ad2-9d4e-70abbad27201 tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.4013160f-b639-4436-9b17-204016a143a9 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:46 devstack sudo[85582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.4013160f-b639-4436-9b17-204016a143a9 Apr 16 19:42:46 devstack sudo[85582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:47 devstack sudo[85582]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5b86fc9c-b24c-4ad2-9d4e-70abbad27201 tempest-SnapshotsActionsTest-1458040281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.4013160f-b639-4436-9b17-204016a143a9" returned: 0 in 0.835s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:47 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-5b86fc9c-b24c-4ad2-9d4e-70abbad27201 tempest-SnapshotsActionsTest-1458040281 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.4013160f-b639-4436-9b17-204016a143a9 is being set with open permissions: ugo+rw Apr 16 19:42:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5b86fc9c-b24c-4ad2-9d4e-70abbad27201 tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.4013160f-b639-4436-9b17-204016a143a9 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:47 devstack sudo[85609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.4013160f-b639-4436-9b17-204016a143a9 Apr 16 19:42:47 devstack sudo[85609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:47 devstack cinder-volume[82569]: INFO cinder.volume.manager [req-1364f16f-02d6-455b-bc3d-992f65432300 req-9c19e67f-6aca-4db9-9284-6742ef76dea1 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Terminate volume connection completed successfully. Apr 16 19:42:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-1364f16f-02d6-455b-bc3d-992f65432300 req-9c19e67f-6aca-4db9-9284-6742ef76dea1 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Deleting attachment 689547b9-eab1-411f-9bb2-5d78e2a05242. {{(pid=82569) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 16 19:42:48 devstack sudo[85609]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5b86fc9c-b24c-4ad2-9d4e-70abbad27201 tempest-SnapshotsActionsTest-1458040281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.4013160f-b639-4436-9b17-204016a143a9" returned: 0 in 0.556s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5b86fc9c-b24c-4ad2-9d4e-70abbad27201 tempest-SnapshotsActionsTest-1458040281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.796s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:42:48 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-5b86fc9c-b24c-4ad2-9d4e-70abbad27201 tempest-SnapshotsActionsTest-1458040281 None] Create snapshot completed successfully Apr 16 19:42:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-1364f16f-02d6-455b-bc3d-992f65432300 req-be84fc26-c05c-4a3f-a721-21f1fceef910 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Acquiring lock "cinder-ce1e2e6a-535f-4105-a70c-97911979c859-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:42:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-1364f16f-02d6-455b-bc3d-992f65432300 req-be84fc26-c05c-4a3f-a721-21f1fceef910 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Lock "cinder-ce1e2e6a-535f-4105-a70c-97911979c859-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:42:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-1364f16f-02d6-455b-bc3d-992f65432300 req-be84fc26-c05c-4a3f-a721-21f1fceef910 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Acquiring lock "cinder-quobyte-ce1e2e6a-535f-4105-a70c-97911979c859" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:42:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-1364f16f-02d6-455b-bc3d-992f65432300 req-be84fc26-c05c-4a3f-a721-21f1fceef910 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Lock "cinder-quobyte-ce1e2e6a-535f-4105-a70c-97911979c859" acquired by "delete_volume" :: waited 0.029s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:42:48 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[230afece-c524-4ec2-aac0-c2c2dfb9efe0]: (4, 'raw') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:42:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-1364f16f-02d6-455b-bc3d-992f65432300 req-be84fc26-c05c-4a3f-a721-21f1fceef910 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:48 devstack sudo[85618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859 Apr 16 19:42:48 devstack sudo[85618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-67c90900-208f-4f56-81b8-57d39f414dc5 tempest-SnapshotsActionsTest-1792954453 None] Acquiring lock "cinder-4013160f-b639-4436-9b17-204016a143a9-delete_snapshot" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:42:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-67c90900-208f-4f56-81b8-57d39f414dc5 tempest-SnapshotsActionsTest-1792954453 None] Lock "cinder-4013160f-b639-4436-9b17-204016a143a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:42:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-67c90900-208f-4f56-81b8-57d39f414dc5 tempest-SnapshotsActionsTest-1792954453 None] Acquiring lock "cinder-quobyte-c35530ce-dd07-4c9b-afa2-5edfa7ac7849" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:42:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-67c90900-208f-4f56-81b8-57d39f414dc5 tempest-SnapshotsActionsTest-1792954453 None] Lock "cinder-quobyte-c35530ce-dd07-4c9b-afa2-5edfa7ac7849" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:42:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-67c90900-208f-4f56-81b8-57d39f414dc5 tempest-SnapshotsActionsTest-1792954453 None] Acquiring lock "cinder-quobyte-4013160f-b639-4436-9b17-204016a143a9" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:42:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-67c90900-208f-4f56-81b8-57d39f414dc5 tempest-SnapshotsActionsTest-1792954453 None] Lock "cinder-quobyte-4013160f-b639-4436-9b17-204016a143a9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:42:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-67c90900-208f-4f56-81b8-57d39f414dc5 tempest-SnapshotsActionsTest-1792954453 None] Deleting offline snapshot 4013160f-b639-4436-9b17-204016a143a9 of volume c35530ce-dd07-4c9b-afa2-5edfa7ac7849 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:42:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-67c90900-208f-4f56-81b8-57d39f414dc5 tempest-SnapshotsActionsTest-1792954453 None] snapshot_file for this snap is: volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.4013160f-b639-4436-9b17-204016a143a9 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:42:48 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53801ee-402d-4a82-803d-86164bd7b77a]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:42:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-67c90900-208f-4f56-81b8-57d39f414dc5 tempest-SnapshotsActionsTest-1792954453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.4013160f-b639-4436-9b17-204016a143a9 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:48 devstack sudo[85631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.4013160f-b639-4436-9b17-204016a143a9 Apr 16 19:42:48 devstack sudo[85631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:49 devstack sudo[85618]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-1364f16f-02d6-455b-bc3d-992f65432300 req-be84fc26-c05c-4a3f-a721-21f1fceef910 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859" returned: 0 in 0.629s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-1364f16f-02d6-455b-bc3d-992f65432300 req-be84fc26-c05c-4a3f-a721-21f1fceef910 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:49 devstack sudo[85638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859 Apr 16 19:42:49 devstack sudo[85638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:49 devstack sudo[85631]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-67c90900-208f-4f56-81b8-57d39f414dc5 tempest-SnapshotsActionsTest-1792954453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.4013160f-b639-4436-9b17-204016a143a9" returned: 0 in 0.869s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:49 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-67c90900-208f-4f56-81b8-57d39f414dc5 tempest-SnapshotsActionsTest-1792954453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:42:49 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b5a79a-c510-4394-a885-0a2e7110e4b7]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:42:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-67c90900-208f-4f56-81b8-57d39f414dc5 tempest-SnapshotsActionsTest-1792954453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:49 devstack sudo[85650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 Apr 16 19:42:49 devstack sudo[85650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:50 devstack sudo[85638]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-1364f16f-02d6-455b-bc3d-992f65432300 req-be84fc26-c05c-4a3f-a721-21f1fceef910 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859" returned: 1 in 0.998s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-1364f16f-02d6-455b-bc3d-992f65432300 req-be84fc26-c05c-4a3f-a721-21f1fceef910 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859' failed. Not Retrying. {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 19:42:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-1364f16f-02d6-455b-bc3d-992f65432300 req-be84fc26-c05c-4a3f-a721-21f1fceef910 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:50 devstack sudo[85664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859 Apr 16 19:42:50 devstack sudo[85664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:50 devstack sudo[85650]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-67c90900-208f-4f56-81b8-57d39f414dc5 tempest-SnapshotsActionsTest-1792954453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597" returned: 0 in 0.816s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-67c90900-208f-4f56-81b8-57d39f414dc5 tempest-SnapshotsActionsTest-1792954453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:42:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-67c90900-208f-4f56-81b8-57d39f414dc5 tempest-SnapshotsActionsTest-1792954453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.4013160f-b639-4436-9b17-204016a143a9 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:50 devstack sudo[85672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.4013160f-b639-4436-9b17-204016a143a9 Apr 16 19:42:50 devstack sudo[85672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:50 devstack sudo[85664]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-1364f16f-02d6-455b-bc3d-992f65432300 req-be84fc26-c05c-4a3f-a721-21f1fceef910 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ce1e2e6a-535f-4105-a70c-97911979c859" returned: 0 in 0.761s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:50 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-1364f16f-02d6-455b-bc3d-992f65432300 req-be84fc26-c05c-4a3f-a721-21f1fceef910 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Lock "cinder-quobyte-ce1e2e6a-535f-4105-a70c-97911979c859" released by "delete_volume" :: held 2.460s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:42:50 devstack cinder-volume[82569]: DEBUG cinder.quota [req-1364f16f-02d6-455b-bc3d-992f65432300 req-be84fc26-c05c-4a3f-a721-21f1fceef910 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Created reservations ['16e55b0b-c4fe-4ca3-9d05-493195c31af9', '4161553a-d533-490a-8617-115b481bcce2', 'a79c8990-ebc3-4634-8c78-96918f37d492', '54b56eb3-0402-4b9a-be3f-1efbe5d43701'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:42:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-1364f16f-02d6-455b-bc3d-992f65432300 req-be84fc26-c05c-4a3f-a721-21f1fceef910 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:42:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-1364f16f-02d6-455b-bc3d-992f65432300 req-be84fc26-c05c-4a3f-a721-21f1fceef910 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:42:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-1364f16f-02d6-455b-bc3d-992f65432300 req-be84fc26-c05c-4a3f-a721-21f1fceef910 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:42:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-1364f16f-02d6-455b-bc3d-992f65432300 req-be84fc26-c05c-4a3f-a721-21f1fceef910 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:42:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-1364f16f-02d6-455b-bc3d-992f65432300 req-be84fc26-c05c-4a3f-a721-21f1fceef910 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:42:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-1364f16f-02d6-455b-bc3d-992f65432300 req-be84fc26-c05c-4a3f-a721-21f1fceef910 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:51 devstack sudo[85676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:42:51 devstack sudo[85676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:51 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:42:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Flow 'volume_create_manager' (9236850d-6b21-4f9f-81d5-e0d22bee3566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:42:51 devstack sudo[85672]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f629eddd-c6f8-4578-ba08-27ddea03aefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f629eddd-c6f8-4578-ba08-27ddea03aefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-253205354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f49b76-e08f-4a30-8fea-790246cb6f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4cfd5a900f242c6b00c98a75c9d6160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:42:51Z,use_quota=True,user_id='bb2ecddf2aac458e92c6f9f71250efc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16350d03-f4b9-4965-961d-a144e0369f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16350d03-f4b9-4965-961d-a144e0369f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef080b95-5d05-4d9a-94b3-bf02df23a0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef080b95-5d05-4d9a-94b3-bf02df23a0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24f49b76-e08f-4a30-8fea-790246cb6f58', 'volume_name': 'volume-24f49b76-e08f-4a30-8fea-790246cb6f58', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea7e314-5717-4880-9d9d-98813d8a563f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea7e314-5717-4880-9d9d-98813d8a563f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7eaeb6-722e-4c5d-9cc0-b92e9dbd5170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:51 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Volume 24f49b76-e08f-4a30-8fea-790246cb6f58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24f49b76-e08f-4a30-8fea-790246cb6f58', 'volume_size': 1} Apr 16 19:42:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:42:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:42:51 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-253205354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f49b76-e08f-4a30-8fea-790246cb6f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4cfd5a900f242c6b00c98a75c9d6160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:42:51Z,use_quota=True,user_id='bb2ecddf2aac458e92c6f9f71250efc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:42:51 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Creating volume 24f49b76-e08f-4a30-8fea-790246cb6f58 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:42:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:42:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:42:51 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:42:51 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:42:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:42:51 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:42:51 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:42:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-24f49b76-e08f-4a30-8fea-790246cb6f58 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-67c90900-208f-4f56-81b8-57d39f414dc5 tempest-SnapshotsActionsTest-1792954453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.4013160f-b639-4436-9b17-204016a143a9" returned: 0 in 0.933s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-67c90900-208f-4f56-81b8-57d39f414dc5 tempest-SnapshotsActionsTest-1792954453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.4013160f-b639-4436-9b17-204016a143a9 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:51 devstack sudo[85687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-24f49b76-e08f-4a30-8fea-790246cb6f58 1073741824 Apr 16 19:42:51 devstack sudo[85687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:51 devstack sudo[85688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.4013160f-b639-4436-9b17-204016a143a9 Apr 16 19:42:51 devstack sudo[85688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:51 devstack sudo[85676]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-1364f16f-02d6-455b-bc3d-992f65432300 req-be84fc26-c05c-4a3f-a721-21f1fceef910 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.607s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:51 devstack cinder-volume[82569]: DEBUG cinder.manager [req-1364f16f-02d6-455b-bc3d-992f65432300 req-be84fc26-c05c-4a3f-a721-21f1fceef910 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:42:51 devstack cinder-volume[82569]: INFO cinder.volume.manager [req-1364f16f-02d6-455b-bc3d-992f65432300 req-be84fc26-c05c-4a3f-a721-21f1fceef910 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Deleted volume successfully. Apr 16 19:42:51 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-1364f16f-02d6-455b-bc3d-992f65432300 req-be84fc26-c05c-4a3f-a721-21f1fceef910 tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Lock "cinder-ce1e2e6a-535f-4105-a70c-97911979c859-delete_volume" released by "delete_volume" :: held 3.298s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:42:52 devstack sudo[85687]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-24f49b76-e08f-4a30-8fea-790246cb6f58 1073741824" returned: 0 in 0.732s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-24f49b76-e08f-4a30-8fea-790246cb6f58 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:52 devstack sudo[85697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-24f49b76-e08f-4a30-8fea-790246cb6f58 Apr 16 19:42:52 devstack sudo[85697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:52 devstack sudo[85688]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-67c90900-208f-4f56-81b8-57d39f414dc5 tempest-SnapshotsActionsTest-1792954453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.4013160f-b639-4436-9b17-204016a143a9" returned: 0 in 0.794s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:52 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-67c90900-208f-4f56-81b8-57d39f414dc5 tempest-SnapshotsActionsTest-1792954453 None] Lock "cinder-quobyte-4013160f-b639-4436-9b17-204016a143a9" released by "_delete_snapshot" :: held 3.477s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:42:52 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-67c90900-208f-4f56-81b8-57d39f414dc5 tempest-SnapshotsActionsTest-1792954453 None] Lock "cinder-quobyte-c35530ce-dd07-4c9b-afa2-5edfa7ac7849" released by "delete_snapshot" :: held 3.502s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:42:52 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-67c90900-208f-4f56-81b8-57d39f414dc5 tempest-SnapshotsActionsTest-1792954453 None] Created reservations ['bf6e4e9c-3218-4fbd-85d0-86513f4dcc3f', '5ef4b00f-3edd-4835-b6af-e4656e3b1a74', '62f02f12-e435-4503-bc4b-06d4d8da0a6d', '4840b459-745d-4f64-8f51-f5711984b682'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:42:52 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-67c90900-208f-4f56-81b8-57d39f414dc5 tempest-SnapshotsActionsTest-1792954453 None] Delete snapshot completed successfully. Apr 16 19:42:52 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-67c90900-208f-4f56-81b8-57d39f414dc5 tempest-SnapshotsActionsTest-1792954453 None] Lock "cinder-4013160f-b639-4436-9b17-204016a143a9-delete_snapshot" released by "delete_snapshot" :: held 3.873s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:42:52 devstack sudo[85697]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-24f49b76-e08f-4a30-8fea-790246cb6f58" returned: 0 in 0.640s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:52 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:42:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:42:52 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7eaeb6-722e-4c5d-9cc0-b92e9dbd5170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24f49b76-e08f-4a30-8fea-790246cb6f58', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:52 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b59438e-b8c4-4155-819a-1456fd1c56ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:52 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Volume volume-24f49b76-e08f-4a30-8fea-790246cb6f58 (24f49b76-e08f-4a30-8fea-790246cb6f58): created successfully Apr 16 19:42:52 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b59438e-b8c4-4155-819a-1456fd1c56ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:52 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Flow 'volume_create_manager' (9236850d-6b21-4f9f-81d5-e0d22bee3566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:42:52 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-66f5c51b-9f95-4756-89cc-163b982c2437 tempest-VolumesTransfersTest-1415620734 None] Created volume successfully. Apr 16 19:42:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2e7a5160-c62a-460a-8910-bb34d7c0ada6 tempest-SnapshotsActionsTest-1458040281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:42:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2e7a5160-c62a-460a-8910-bb34d7c0ada6 tempest-SnapshotsActionsTest-1458040281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:42:53 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-2e7a5160-c62a-460a-8910-bb34d7c0ada6 tempest-SnapshotsActionsTest-1458040281 None] Creating offline snapshot 686ab88b-5eb8-4938-a11b-92197cef7315 of volume c35530ce-dd07-4c9b-afa2-5edfa7ac7849 {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:42:53 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7fe944-25a4-479e-84f8-6a5779b62829]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:42:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2e7a5160-c62a-460a-8910-bb34d7c0ada6 tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:53 devstack sudo[85753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 Apr 16 19:42:53 devstack sudo[85753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:54 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-95b4c7c9-60f3-4d9d-be4c-11d74fe090d6 tempest-VolumesTransfersTest-384021401 None] Transfer volume completed successfully. Apr 16 19:42:54 devstack sudo[85753]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2e7a5160-c62a-460a-8910-bb34d7c0ada6 tempest-SnapshotsActionsTest-1458040281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597" returned: 0 in 1.305s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:54 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-2e7a5160-c62a-460a-8910-bb34d7c0ada6 tempest-SnapshotsActionsTest-1458040281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:42:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2e7a5160-c62a-460a-8910-bb34d7c0ada6 tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.686ab88b-5eb8-4938-a11b-92197cef7315 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:54 devstack sudo[85764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.686ab88b-5eb8-4938-a11b-92197cef7315 1G Apr 16 19:42:54 devstack sudo[85764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:55 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-655bd0b8-b80c-45ab-9055-4afc3666a537 tempest-VolumesTransfersTest-2011453692 None] Acquiring lock "cinder-24f49b76-e08f-4a30-8fea-790246cb6f58-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:42:55 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-655bd0b8-b80c-45ab-9055-4afc3666a537 tempest-VolumesTransfersTest-2011453692 None] Lock "cinder-24f49b76-e08f-4a30-8fea-790246cb6f58-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:42:55 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-655bd0b8-b80c-45ab-9055-4afc3666a537 tempest-VolumesTransfersTest-2011453692 None] Acquiring lock "cinder-quobyte-24f49b76-e08f-4a30-8fea-790246cb6f58" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:42:55 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-655bd0b8-b80c-45ab-9055-4afc3666a537 tempest-VolumesTransfersTest-2011453692 None] Lock "cinder-quobyte-24f49b76-e08f-4a30-8fea-790246cb6f58" acquired by "delete_volume" :: waited 0.015s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:42:55 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b14cb7f-365e-4872-8ff7-3ceb6f27e888]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:42:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-655bd0b8-b80c-45ab-9055-4afc3666a537 tempest-VolumesTransfersTest-2011453692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-24f49b76-e08f-4a30-8fea-790246cb6f58 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:55 devstack sudo[85764]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2e7a5160-c62a-460a-8910-bb34d7c0ada6 tempest-SnapshotsActionsTest-1458040281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.686ab88b-5eb8-4938-a11b-92197cef7315 1G" returned: 0 in 1.183s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2e7a5160-c62a-460a-8910-bb34d7c0ada6 tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.686ab88b-5eb8-4938-a11b-92197cef7315 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:55 devstack sudo[85773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.686ab88b-5eb8-4938-a11b-92197cef7315 Apr 16 19:42:55 devstack sudo[85773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:55 devstack sudo[85772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-24f49b76-e08f-4a30-8fea-790246cb6f58 Apr 16 19:42:55 devstack sudo[85772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:56 devstack sudo[85773]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2e7a5160-c62a-460a-8910-bb34d7c0ada6 tempest-SnapshotsActionsTest-1458040281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.686ab88b-5eb8-4938-a11b-92197cef7315" returned: 0 in 0.488s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:56 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-2e7a5160-c62a-460a-8910-bb34d7c0ada6 tempest-SnapshotsActionsTest-1458040281 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.686ab88b-5eb8-4938-a11b-92197cef7315 is being set with open permissions: ugo+rw Apr 16 19:42:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2e7a5160-c62a-460a-8910-bb34d7c0ada6 tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.686ab88b-5eb8-4938-a11b-92197cef7315 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:56 devstack sudo[85772]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-655bd0b8-b80c-45ab-9055-4afc3666a537 tempest-VolumesTransfersTest-2011453692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-24f49b76-e08f-4a30-8fea-790246cb6f58" returned: 0 in 0.541s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-655bd0b8-b80c-45ab-9055-4afc3666a537 tempest-VolumesTransfersTest-2011453692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-24f49b76-e08f-4a30-8fea-790246cb6f58 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:56 devstack sudo[85782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.686ab88b-5eb8-4938-a11b-92197cef7315 Apr 16 19:42:56 devstack sudo[85782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:56 devstack sudo[85783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-24f49b76-e08f-4a30-8fea-790246cb6f58 Apr 16 19:42:56 devstack sudo[85783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:57 devstack sudo[85783]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-655bd0b8-b80c-45ab-9055-4afc3666a537 tempest-VolumesTransfersTest-2011453692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-24f49b76-e08f-4a30-8fea-790246cb6f58" returned: 0 in 0.800s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:57 devstack sudo[85782]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2e7a5160-c62a-460a-8910-bb34d7c0ada6 tempest-SnapshotsActionsTest-1458040281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.686ab88b-5eb8-4938-a11b-92197cef7315" returned: 0 in 0.846s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-655bd0b8-b80c-45ab-9055-4afc3666a537 tempest-VolumesTransfersTest-2011453692 None] Lock "cinder-quobyte-24f49b76-e08f-4a30-8fea-790246cb6f58" released by "delete_volume" :: held 1.381s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:42:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2e7a5160-c62a-460a-8910-bb34d7c0ada6 tempest-SnapshotsActionsTest-1458040281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.019s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:42:57 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-655bd0b8-b80c-45ab-9055-4afc3666a537 tempest-VolumesTransfersTest-2011453692 None] Created reservations ['f904617b-7158-4817-a9d9-08d63e0ea1de', '1186d70f-d882-438a-9522-5464f35d290f', '5bb8b82d-9006-45e7-888c-2dd6329d5fd0', 'ee439d4d-e034-419c-97df-bd3091f2c4a3'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:42:57 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-2e7a5160-c62a-460a-8910-bb34d7c0ada6 tempest-SnapshotsActionsTest-1458040281 None] Create snapshot completed successfully Apr 16 19:42:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-655bd0b8-b80c-45ab-9055-4afc3666a537 tempest-VolumesTransfersTest-2011453692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:42:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-655bd0b8-b80c-45ab-9055-4afc3666a537 tempest-VolumesTransfersTest-2011453692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:42:57 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-655bd0b8-b80c-45ab-9055-4afc3666a537 tempest-VolumesTransfersTest-2011453692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:42:57 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-655bd0b8-b80c-45ab-9055-4afc3666a537 tempest-VolumesTransfersTest-2011453692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:42:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-655bd0b8-b80c-45ab-9055-4afc3666a537 tempest-VolumesTransfersTest-2011453692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:42:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-655bd0b8-b80c-45ab-9055-4afc3666a537 tempest-VolumesTransfersTest-2011453692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:57 devstack sudo[85839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:42:57 devstack sudo[85839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0c545280-68b4-4a1e-bb9b-8423225062ec tempest-SnapshotsActionsTest-1792954453 None] Acquiring lock "cinder-686ab88b-5eb8-4938-a11b-92197cef7315-delete_snapshot" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:42:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0c545280-68b4-4a1e-bb9b-8423225062ec tempest-SnapshotsActionsTest-1792954453 None] Lock "cinder-686ab88b-5eb8-4938-a11b-92197cef7315-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:42:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0c545280-68b4-4a1e-bb9b-8423225062ec tempest-SnapshotsActionsTest-1792954453 None] Acquiring lock "cinder-quobyte-c35530ce-dd07-4c9b-afa2-5edfa7ac7849" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:42:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0c545280-68b4-4a1e-bb9b-8423225062ec tempest-SnapshotsActionsTest-1792954453 None] Lock "cinder-quobyte-c35530ce-dd07-4c9b-afa2-5edfa7ac7849" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:42:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0c545280-68b4-4a1e-bb9b-8423225062ec tempest-SnapshotsActionsTest-1792954453 None] Acquiring lock "cinder-quobyte-686ab88b-5eb8-4938-a11b-92197cef7315" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:42:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0c545280-68b4-4a1e-bb9b-8423225062ec tempest-SnapshotsActionsTest-1792954453 None] Lock "cinder-quobyte-686ab88b-5eb8-4938-a11b-92197cef7315" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:42:57 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-0c545280-68b4-4a1e-bb9b-8423225062ec tempest-SnapshotsActionsTest-1792954453 None] Deleting offline snapshot 686ab88b-5eb8-4938-a11b-92197cef7315 of volume c35530ce-dd07-4c9b-afa2-5edfa7ac7849 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:42:57 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-0c545280-68b4-4a1e-bb9b-8423225062ec tempest-SnapshotsActionsTest-1792954453 None] snapshot_file for this snap is: volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.686ab88b-5eb8-4938-a11b-92197cef7315 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:42:57 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ae1a09-345f-4478-afec-27d777362092]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:42:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0c545280-68b4-4a1e-bb9b-8423225062ec tempest-SnapshotsActionsTest-1792954453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.686ab88b-5eb8-4938-a11b-92197cef7315 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:58 devstack sudo[85841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.686ab88b-5eb8-4938-a11b-92197cef7315 Apr 16 19:42:58 devstack sudo[85841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:58 devstack sudo[85839]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-655bd0b8-b80c-45ab-9055-4afc3666a537 tempest-VolumesTransfersTest-2011453692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 1.019s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-655bd0b8-b80c-45ab-9055-4afc3666a537 tempest-VolumesTransfersTest-2011453692 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:42:58 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-655bd0b8-b80c-45ab-9055-4afc3666a537 tempest-VolumesTransfersTest-2011453692 None] Deleted volume successfully. Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-655bd0b8-b80c-45ab-9055-4afc3666a537 tempest-VolumesTransfersTest-2011453692 None] Lock "cinder-24f49b76-e08f-4a30-8fea-790246cb6f58-delete_volume" released by "delete_volume" :: held 2.745s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Flow 'volume_create_manager' (74c082ba-330f-4ed5-8c16-37f8bf9c1b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c905a3-0f09-4a25-b748-5e679fd6db0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c905a3-0f09-4a25-b748-5e679fd6db0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-951177209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c5bd95-270b-47e7-af4c-6577ff91235e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4cfd5a900f242c6b00c98a75c9d6160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:42:59Z,use_quota=True,user_id='bb2ecddf2aac458e92c6f9f71250efc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b69eff34-60a5-46b6-958d-826940f89d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b69eff34-60a5-46b6-958d-826940f89d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e2f40f1-3be0-4bf8-9bfe-474a9a025555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e2f40f1-3be0-4bf8-9bfe-474a9a025555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03c5bd95-270b-47e7-af4c-6577ff91235e', 'volume_name': 'volume-03c5bd95-270b-47e7-af4c-6577ff91235e', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c0f2b1-1519-4f12-b99a-525ccd9ceffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c0f2b1-1519-4f12-b99a-525ccd9ceffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b765a7d0-47a0-4ffe-843d-33636f04539d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:42:58 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Volume 03c5bd95-270b-47e7-af4c-6577ff91235e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03c5bd95-270b-47e7-af4c-6577ff91235e', 'volume_size': 1} Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-951177209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c5bd95-270b-47e7-af4c-6577ff91235e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4cfd5a900f242c6b00c98a75c9d6160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:42:59Z,use_quota=True,user_id='bb2ecddf2aac458e92c6f9f71250efc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Creating volume 03c5bd95-270b-47e7-af4c-6577ff91235e {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:42:58 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-03c5bd95-270b-47e7-af4c-6577ff91235e 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:58 devstack sudo[85847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-03c5bd95-270b-47e7-af4c-6577ff91235e 1073741824 Apr 16 19:42:58 devstack sudo[85847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:58 devstack sudo[85841]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0c545280-68b4-4a1e-bb9b-8423225062ec tempest-SnapshotsActionsTest-1792954453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.686ab88b-5eb8-4938-a11b-92197cef7315" returned: 0 in 1.205s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-0c545280-68b4-4a1e-bb9b-8423225062ec tempest-SnapshotsActionsTest-1792954453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[8680eb08-ab54-4f27-af43-2e9c119d02ce]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:42:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0c545280-68b4-4a1e-bb9b-8423225062ec tempest-SnapshotsActionsTest-1792954453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:59 devstack sudo[85852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 Apr 16 19:42:59 devstack sudo[85852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:59 devstack sudo[85847]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-03c5bd95-270b-47e7-af4c-6577ff91235e 1073741824" returned: 0 in 0.681s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-03c5bd95-270b-47e7-af4c-6577ff91235e {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:59 devstack sudo[85860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-03c5bd95-270b-47e7-af4c-6577ff91235e Apr 16 19:42:59 devstack sudo[85860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-45a98157-367a-42fc-ae47-03559421e52e tempest-ServerRescueNegativeTestJSON-1175012910 None] Acquiring lock "cinder-c6dafb63-8842-41da-bbcc-8b7fc23d9984-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:42:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-45a98157-367a-42fc-ae47-03559421e52e tempest-ServerRescueNegativeTestJSON-1175012910 None] Lock "cinder-c6dafb63-8842-41da-bbcc-8b7fc23d9984-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:42:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-45a98157-367a-42fc-ae47-03559421e52e tempest-ServerRescueNegativeTestJSON-1175012910 None] Acquiring lock "cinder-quobyte-c6dafb63-8842-41da-bbcc-8b7fc23d9984" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:42:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-45a98157-367a-42fc-ae47-03559421e52e tempest-ServerRescueNegativeTestJSON-1175012910 None] Lock "cinder-quobyte-c6dafb63-8842-41da-bbcc-8b7fc23d9984" acquired by "delete_volume" :: waited 0.013s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:42:59 devstack sudo[85852]: pam_unix(sudo:session): session closed for user root Apr 16 19:42:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0c545280-68b4-4a1e-bb9b-8423225062ec tempest-SnapshotsActionsTest-1792954453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597" returned: 0 in 0.993s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:42:59 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-0c545280-68b4-4a1e-bb9b-8423225062ec tempest-SnapshotsActionsTest-1792954453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:42:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0c545280-68b4-4a1e-bb9b-8423225062ec tempest-SnapshotsActionsTest-1792954453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.686ab88b-5eb8-4938-a11b-92197cef7315 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:42:59 devstack sudo[85865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.686ab88b-5eb8-4938-a11b-92197cef7315 Apr 16 19:42:59 devstack sudo[85865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:42:59 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5d6aee-dcc9-4f88-a1b2-413a808aaa03]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:42:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-45a98157-367a-42fc-ae47-03559421e52e tempest-ServerRescueNegativeTestJSON-1175012910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c6dafb63-8842-41da-bbcc-8b7fc23d9984 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:00 devstack sudo[85867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c6dafb63-8842-41da-bbcc-8b7fc23d9984 Apr 16 19:43:00 devstack sudo[85867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:00 devstack sudo[85860]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-03c5bd95-270b-47e7-af4c-6577ff91235e" returned: 0 in 0.808s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:00 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:43:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b765a7d0-47a0-4ffe-843d-33636f04539d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03c5bd95-270b-47e7-af4c-6577ff91235e', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51cf88cc-7142-4081-acf5-c30b036d64f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:00 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Volume volume-03c5bd95-270b-47e7-af4c-6577ff91235e (03c5bd95-270b-47e7-af4c-6577ff91235e): created successfully Apr 16 19:43:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51cf88cc-7142-4081-acf5-c30b036d64f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Flow 'volume_create_manager' (74c082ba-330f-4ed5-8c16-37f8bf9c1b6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:00 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-31b4e664-60d8-4c44-9531-d4fdb3a7d923 tempest-VolumesTransfersTest-1415620734 None] Created volume successfully. Apr 16 19:43:00 devstack sudo[85867]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-45a98157-367a-42fc-ae47-03559421e52e tempest-ServerRescueNegativeTestJSON-1175012910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c6dafb63-8842-41da-bbcc-8b7fc23d9984" returned: 0 in 0.757s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-45a98157-367a-42fc-ae47-03559421e52e tempest-ServerRescueNegativeTestJSON-1175012910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c6dafb63-8842-41da-bbcc-8b7fc23d9984 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:00 devstack sudo[85896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c6dafb63-8842-41da-bbcc-8b7fc23d9984 Apr 16 19:43:00 devstack sudo[85896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:00 devstack sudo[85865]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0c545280-68b4-4a1e-bb9b-8423225062ec tempest-SnapshotsActionsTest-1792954453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.686ab88b-5eb8-4938-a11b-92197cef7315" returned: 0 in 0.946s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0c545280-68b4-4a1e-bb9b-8423225062ec tempest-SnapshotsActionsTest-1792954453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.686ab88b-5eb8-4938-a11b-92197cef7315 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:00 devstack sudo[85898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.686ab88b-5eb8-4938-a11b-92197cef7315 Apr 16 19:43:00 devstack sudo[85898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0757a79b-2a0b-4e5d-a3df-8a63ed07c2a2 tempest-VolumesTransfersTest-2011453692 None] Acquiring lock "cinder-03c5bd95-270b-47e7-af4c-6577ff91235e-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0757a79b-2a0b-4e5d-a3df-8a63ed07c2a2 tempest-VolumesTransfersTest-2011453692 None] Lock "cinder-03c5bd95-270b-47e7-af4c-6577ff91235e-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0757a79b-2a0b-4e5d-a3df-8a63ed07c2a2 tempest-VolumesTransfersTest-2011453692 None] Acquiring lock "cinder-quobyte-03c5bd95-270b-47e7-af4c-6577ff91235e" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0757a79b-2a0b-4e5d-a3df-8a63ed07c2a2 tempest-VolumesTransfersTest-2011453692 None] Lock "cinder-quobyte-03c5bd95-270b-47e7-af4c-6577ff91235e" acquired by "delete_volume" :: waited 0.026s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:01 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec45a365-499f-4aa5-ad8d-606dfb0a670f]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:43:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0757a79b-2a0b-4e5d-a3df-8a63ed07c2a2 tempest-VolumesTransfersTest-2011453692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-03c5bd95-270b-47e7-af4c-6577ff91235e {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:01 devstack sudo[85903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-03c5bd95-270b-47e7-af4c-6577ff91235e Apr 16 19:43:01 devstack sudo[85903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:01 devstack sudo[85898]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0c545280-68b4-4a1e-bb9b-8423225062ec tempest-SnapshotsActionsTest-1792954453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.686ab88b-5eb8-4938-a11b-92197cef7315" returned: 0 in 0.869s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:01 devstack sudo[85896]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-45a98157-367a-42fc-ae47-03559421e52e tempest-ServerRescueNegativeTestJSON-1175012910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c6dafb63-8842-41da-bbcc-8b7fc23d9984" returned: 0 in 1.067s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0c545280-68b4-4a1e-bb9b-8423225062ec tempest-SnapshotsActionsTest-1792954453 None] Lock "cinder-quobyte-686ab88b-5eb8-4938-a11b-92197cef7315" released by "_delete_snapshot" :: held 4.127s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-45a98157-367a-42fc-ae47-03559421e52e tempest-ServerRescueNegativeTestJSON-1175012910 None] Lock "cinder-quobyte-c6dafb63-8842-41da-bbcc-8b7fc23d9984" released by "delete_volume" :: held 1.921s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0c545280-68b4-4a1e-bb9b-8423225062ec tempest-SnapshotsActionsTest-1792954453 None] Lock "cinder-quobyte-c35530ce-dd07-4c9b-afa2-5edfa7ac7849" released by "delete_snapshot" :: held 4.149s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:01 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-45a98157-367a-42fc-ae47-03559421e52e tempest-ServerRescueNegativeTestJSON-1175012910 None] Created reservations ['b48e811d-b387-4277-8701-c2347e01d2aa', '5f16167e-088f-4e71-84b6-3300819ef6a0', 'e24c24dc-08e2-4ed9-95db-c066514c74ae', '7b061ac4-bb56-4308-8515-696a406dda43'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:43:02 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-0c545280-68b4-4a1e-bb9b-8423225062ec tempest-SnapshotsActionsTest-1792954453 None] Created reservations ['dd8c156f-565d-456e-bd62-98ab6a30ac2d', '298e629e-f188-413e-85dc-44ff29e1e51f', '163847cd-b320-43ba-855e-9fedadca0db3', '878d4020-58f9-4d82-b642-b01423af4ad4'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:43:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-45a98157-367a-42fc-ae47-03559421e52e tempest-ServerRescueNegativeTestJSON-1175012910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-45a98157-367a-42fc-ae47-03559421e52e tempest-ServerRescueNegativeTestJSON-1175012910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:02 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-45a98157-367a-42fc-ae47-03559421e52e tempest-ServerRescueNegativeTestJSON-1175012910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:02 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-45a98157-367a-42fc-ae47-03559421e52e tempest-ServerRescueNegativeTestJSON-1175012910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-45a98157-367a-42fc-ae47-03559421e52e tempest-ServerRescueNegativeTestJSON-1175012910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-45a98157-367a-42fc-ae47-03559421e52e tempest-ServerRescueNegativeTestJSON-1175012910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:02 devstack sudo[85916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:43:02 devstack sudo[85916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:02 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-0c545280-68b4-4a1e-bb9b-8423225062ec tempest-SnapshotsActionsTest-1792954453 None] Delete snapshot completed successfully. Apr 16 19:43:02 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0c545280-68b4-4a1e-bb9b-8423225062ec tempest-SnapshotsActionsTest-1792954453 None] Lock "cinder-686ab88b-5eb8-4938-a11b-92197cef7315-delete_snapshot" released by "delete_snapshot" :: held 4.435s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:02 devstack sudo[85903]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0757a79b-2a0b-4e5d-a3df-8a63ed07c2a2 tempest-VolumesTransfersTest-2011453692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-03c5bd95-270b-47e7-af4c-6577ff91235e" returned: 0 in 0.767s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0757a79b-2a0b-4e5d-a3df-8a63ed07c2a2 tempest-VolumesTransfersTest-2011453692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-03c5bd95-270b-47e7-af4c-6577ff91235e {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:02 devstack sudo[85937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-03c5bd95-270b-47e7-af4c-6577ff91235e Apr 16 19:43:02 devstack sudo[85937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:02 devstack sudo[85916]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-45a98157-367a-42fc-ae47-03559421e52e tempest-ServerRescueNegativeTestJSON-1175012910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.927s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:02 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-45a98157-367a-42fc-ae47-03559421e52e tempest-ServerRescueNegativeTestJSON-1175012910 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:43:02 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-45a98157-367a-42fc-ae47-03559421e52e tempest-ServerRescueNegativeTestJSON-1175012910 None] Deleted volume successfully. Apr 16 19:43:03 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-45a98157-367a-42fc-ae47-03559421e52e tempest-ServerRescueNegativeTestJSON-1175012910 None] Lock "cinder-c6dafb63-8842-41da-bbcc-8b7fc23d9984-delete_volume" released by "delete_volume" :: held 3.220s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:03 devstack sudo[85937]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0757a79b-2a0b-4e5d-a3df-8a63ed07c2a2 tempest-VolumesTransfersTest-2011453692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-03c5bd95-270b-47e7-af4c-6577ff91235e" returned: 0 in 0.889s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:03 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0757a79b-2a0b-4e5d-a3df-8a63ed07c2a2 tempest-VolumesTransfersTest-2011453692 None] Lock "cinder-quobyte-03c5bd95-270b-47e7-af4c-6577ff91235e" released by "delete_volume" :: held 1.683s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:03 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-0757a79b-2a0b-4e5d-a3df-8a63ed07c2a2 tempest-VolumesTransfersTest-2011453692 None] Created reservations ['45ec66c3-0e26-4559-887d-0341aca1432b', '58e11b77-e250-4e8f-9747-48abe335fbb5', '03142fbb-ad0a-415e-93b0-f15c7ca12b40', '395f7d25-ec20-47ce-8a4c-6ab60820d190'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:43:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0757a79b-2a0b-4e5d-a3df-8a63ed07c2a2 tempest-VolumesTransfersTest-2011453692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0757a79b-2a0b-4e5d-a3df-8a63ed07c2a2 tempest-VolumesTransfersTest-2011453692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:03 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0757a79b-2a0b-4e5d-a3df-8a63ed07c2a2 tempest-VolumesTransfersTest-2011453692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:03 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0757a79b-2a0b-4e5d-a3df-8a63ed07c2a2 tempest-VolumesTransfersTest-2011453692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0757a79b-2a0b-4e5d-a3df-8a63ed07c2a2 tempest-VolumesTransfersTest-2011453692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0757a79b-2a0b-4e5d-a3df-8a63ed07c2a2 tempest-VolumesTransfersTest-2011453692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:03 devstack sudo[85955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:43:03 devstack sudo[85955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:03 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-cc6a9514-056a-498f-8d61-2ac52460aa17 tempest-SnapshotsActionsTest-1458040281 None] Acquiring lock "cinder-ccdbab62-035d-4273-8bb6-f120e2457597-delete_snapshot" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:03 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-cc6a9514-056a-498f-8d61-2ac52460aa17 tempest-SnapshotsActionsTest-1458040281 None] Lock "cinder-ccdbab62-035d-4273-8bb6-f120e2457597-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:03 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-cc6a9514-056a-498f-8d61-2ac52460aa17 tempest-SnapshotsActionsTest-1458040281 None] Acquiring lock "cinder-quobyte-c35530ce-dd07-4c9b-afa2-5edfa7ac7849" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:03 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-cc6a9514-056a-498f-8d61-2ac52460aa17 tempest-SnapshotsActionsTest-1458040281 None] Lock "cinder-quobyte-c35530ce-dd07-4c9b-afa2-5edfa7ac7849" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:03 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-cc6a9514-056a-498f-8d61-2ac52460aa17 tempest-SnapshotsActionsTest-1458040281 None] Acquiring lock "cinder-quobyte-ccdbab62-035d-4273-8bb6-f120e2457597" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:03 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-cc6a9514-056a-498f-8d61-2ac52460aa17 tempest-SnapshotsActionsTest-1458040281 None] Lock "cinder-quobyte-ccdbab62-035d-4273-8bb6-f120e2457597" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:03 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-cc6a9514-056a-498f-8d61-2ac52460aa17 tempest-SnapshotsActionsTest-1458040281 None] Deleting offline snapshot ccdbab62-035d-4273-8bb6-f120e2457597 of volume c35530ce-dd07-4c9b-afa2-5edfa7ac7849 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:43:03 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-cc6a9514-056a-498f-8d61-2ac52460aa17 tempest-SnapshotsActionsTest-1458040281 None] snapshot_file for this snap is: volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:43:03 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a8d8f5-3c8f-4382-897c-80fd03f4fb7e]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:43:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-cc6a9514-056a-498f-8d61-2ac52460aa17 tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:03 devstack sudo[85963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 Apr 16 19:43:03 devstack sudo[85963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:03 devstack cinder-volume[82569]: INFO cinder.volume.manager [req-5272a069-b9f2-4a1b-9a2c-0889afaa62ed req-29dad0c6-c2ed-4ebc-b029-34ba4c14b36b tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Terminate volume connection completed successfully. Apr 16 19:43:03 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-5272a069-b9f2-4a1b-9a2c-0889afaa62ed req-29dad0c6-c2ed-4ebc-b029-34ba4c14b36b tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Deleting attachment 7fe8f1ed-082a-4bc6-8856-df6a10a9987b. {{(pid=82569) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 16 19:43:03 devstack sudo[85955]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0757a79b-2a0b-4e5d-a3df-8a63ed07c2a2 tempest-VolumesTransfersTest-2011453692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.686s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:03 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-0757a79b-2a0b-4e5d-a3df-8a63ed07c2a2 tempest-VolumesTransfersTest-2011453692 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:43:03 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-0757a79b-2a0b-4e5d-a3df-8a63ed07c2a2 tempest-VolumesTransfersTest-2011453692 None] Deleted volume successfully. Apr 16 19:43:03 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0757a79b-2a0b-4e5d-a3df-8a63ed07c2a2 tempest-VolumesTransfersTest-2011453692 None] Lock "cinder-03c5bd95-270b-47e7-af4c-6577ff91235e-delete_volume" released by "delete_volume" :: held 2.648s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:04 devstack cinder-volume[82569]: DEBUG oslo_service.periodic_task [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82569) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 19:43:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:04 devstack sudo[85984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:43:04 devstack sudo[85984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:04 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-5272a069-b9f2-4a1b-9a2c-0889afaa62ed req-edf2340b-ae8c-4ceb-9a0f-1bade6d3692c tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Acquiring lock "cinder-443b3a7a-1e66-4f90-918d-b2779486166b-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:04 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-5272a069-b9f2-4a1b-9a2c-0889afaa62ed req-edf2340b-ae8c-4ceb-9a0f-1bade6d3692c tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Lock "cinder-443b3a7a-1e66-4f90-918d-b2779486166b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:04 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-5272a069-b9f2-4a1b-9a2c-0889afaa62ed req-edf2340b-ae8c-4ceb-9a0f-1bade6d3692c tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Acquiring lock "cinder-quobyte-443b3a7a-1e66-4f90-918d-b2779486166b" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:04 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-5272a069-b9f2-4a1b-9a2c-0889afaa62ed req-edf2340b-ae8c-4ceb-9a0f-1bade6d3692c tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Lock "cinder-quobyte-443b3a7a-1e66-4f90-918d-b2779486166b" acquired by "delete_volume" :: waited 0.033s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:04 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[13340da5-4bc2-47eb-a280-136d04c421fe]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:43:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-5272a069-b9f2-4a1b-9a2c-0889afaa62ed req-edf2340b-ae8c-4ceb-9a0f-1bade6d3692c tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-443b3a7a-1e66-4f90-918d-b2779486166b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:04 devstack sudo[85963]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-cc6a9514-056a-498f-8d61-2ac52460aa17 tempest-SnapshotsActionsTest-1458040281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597" returned: 0 in 1.128s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-cc6a9514-056a-498f-8d61-2ac52460aa17 tempest-SnapshotsActionsTest-1458040281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:43:04 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[687c5e49-7f2d-474b-ac30-6857bc53a238]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:43:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-cc6a9514-056a-498f-8d61-2ac52460aa17 tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:04 devstack sudo[85990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-443b3a7a-1e66-4f90-918d-b2779486166b Apr 16 19:43:04 devstack sudo[85990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:04 devstack sudo[85991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849 Apr 16 19:43:04 devstack sudo[85991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:04 devstack sudo[85984]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.872s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:04 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:43:05 devstack sudo[85990]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-5272a069-b9f2-4a1b-9a2c-0889afaa62ed req-edf2340b-ae8c-4ceb-9a0f-1bade6d3692c tempest-ServerBootFromVolumeStableRescueTest-883281893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-443b3a7a-1e66-4f90-918d-b2779486166b" returned: 0 in 0.731s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-5272a069-b9f2-4a1b-9a2c-0889afaa62ed req-edf2340b-ae8c-4ceb-9a0f-1bade6d3692c tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-443b3a7a-1e66-4f90-918d-b2779486166b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:05 devstack sudo[85999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-443b3a7a-1e66-4f90-918d-b2779486166b Apr 16 19:43:05 devstack sudo[85999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:05 devstack sudo[85991]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-cc6a9514-056a-498f-8d61-2ac52460aa17 tempest-SnapshotsActionsTest-1458040281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849" returned: 0 in 1.069s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-cc6a9514-056a-498f-8d61-2ac52460aa17 tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:05 devstack sudo[86005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 Apr 16 19:43:05 devstack sudo[86005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:06 devstack sudo[85999]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-5272a069-b9f2-4a1b-9a2c-0889afaa62ed req-edf2340b-ae8c-4ceb-9a0f-1bade6d3692c tempest-ServerBootFromVolumeStableRescueTest-883281893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-443b3a7a-1e66-4f90-918d-b2779486166b" returned: 0 in 0.813s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:06 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-5272a069-b9f2-4a1b-9a2c-0889afaa62ed req-edf2340b-ae8c-4ceb-9a0f-1bade6d3692c tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Lock "cinder-quobyte-443b3a7a-1e66-4f90-918d-b2779486166b" released by "delete_volume" :: held 1.581s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:06 devstack cinder-volume[82569]: DEBUG cinder.quota [req-5272a069-b9f2-4a1b-9a2c-0889afaa62ed req-edf2340b-ae8c-4ceb-9a0f-1bade6d3692c tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Created reservations ['b73a8ac0-d17d-45a9-ab7d-833f5424f34b', '201938f5-f275-4d96-a8da-70b2f155fc2c', 'db71f70e-0b7a-42ab-a6b1-d5ddef479a55', 'd15e0b86-ee4f-4770-95eb-00c32d269a39'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:43:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-5272a069-b9f2-4a1b-9a2c-0889afaa62ed req-edf2340b-ae8c-4ceb-9a0f-1bade6d3692c tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-5272a069-b9f2-4a1b-9a2c-0889afaa62ed req-edf2340b-ae8c-4ceb-9a0f-1bade6d3692c tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:06 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-5272a069-b9f2-4a1b-9a2c-0889afaa62ed req-edf2340b-ae8c-4ceb-9a0f-1bade6d3692c tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:06 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-5272a069-b9f2-4a1b-9a2c-0889afaa62ed req-edf2340b-ae8c-4ceb-9a0f-1bade6d3692c tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-5272a069-b9f2-4a1b-9a2c-0889afaa62ed req-edf2340b-ae8c-4ceb-9a0f-1bade6d3692c tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-5272a069-b9f2-4a1b-9a2c-0889afaa62ed req-edf2340b-ae8c-4ceb-9a0f-1bade6d3692c tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:06 devstack sudo[86012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:43:06 devstack sudo[86012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:06 devstack sudo[86005]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-cc6a9514-056a-498f-8d61-2ac52460aa17 tempest-SnapshotsActionsTest-1458040281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597" returned: 0 in 0.712s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-cc6a9514-056a-498f-8d61-2ac52460aa17 tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:06 devstack sudo[86014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597 Apr 16 19:43:06 devstack sudo[86014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:07 devstack sudo[86012]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-5272a069-b9f2-4a1b-9a2c-0889afaa62ed req-edf2340b-ae8c-4ceb-9a0f-1bade6d3692c tempest-ServerBootFromVolumeStableRescueTest-883281893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.725s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:07 devstack cinder-volume[82569]: DEBUG cinder.manager [req-5272a069-b9f2-4a1b-9a2c-0889afaa62ed req-edf2340b-ae8c-4ceb-9a0f-1bade6d3692c tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:43:07 devstack cinder-volume[82569]: INFO cinder.volume.manager [req-5272a069-b9f2-4a1b-9a2c-0889afaa62ed req-edf2340b-ae8c-4ceb-9a0f-1bade6d3692c tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Deleted volume successfully. Apr 16 19:43:07 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-5272a069-b9f2-4a1b-9a2c-0889afaa62ed req-edf2340b-ae8c-4ceb-9a0f-1bade6d3692c tempest-ServerBootFromVolumeStableRescueTest-883281893 None] Lock "cinder-443b3a7a-1e66-4f90-918d-b2779486166b-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:07 devstack sudo[86014]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-cc6a9514-056a-498f-8d61-2ac52460aa17 tempest-SnapshotsActionsTest-1458040281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849.ccdbab62-035d-4273-8bb6-f120e2457597" returned: 0 in 0.740s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:07 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-cc6a9514-056a-498f-8d61-2ac52460aa17 tempest-SnapshotsActionsTest-1458040281 None] Lock "cinder-quobyte-ccdbab62-035d-4273-8bb6-f120e2457597" released by "_delete_snapshot" :: held 3.790s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:07 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-cc6a9514-056a-498f-8d61-2ac52460aa17 tempest-SnapshotsActionsTest-1458040281 None] Lock "cinder-quobyte-c35530ce-dd07-4c9b-afa2-5edfa7ac7849" released by "delete_snapshot" :: held 3.804s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:07 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-cc6a9514-056a-498f-8d61-2ac52460aa17 tempest-SnapshotsActionsTest-1458040281 None] Created reservations ['1c910620-35b9-4f74-af3b-bc04cc5fb303', '2d284b2c-b69e-411e-bb7b-1746ba0f90c8', 'eb07dbfa-211c-420e-9827-a54a3fe6cd55', 'a82525e4-183a-46e1-9d31-8870ecb1fe17'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:43:07 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-cc6a9514-056a-498f-8d61-2ac52460aa17 tempest-SnapshotsActionsTest-1458040281 None] Delete snapshot completed successfully. Apr 16 19:43:07 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-cc6a9514-056a-498f-8d61-2ac52460aa17 tempest-SnapshotsActionsTest-1458040281 None] Lock "cinder-ccdbab62-035d-4273-8bb6-f120e2457597-delete_snapshot" released by "delete_snapshot" :: held 3.920s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:07 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9c6215a4-60ca-4965-936d-1302223fcdd2 tempest-SnapshotsActionsTest-1458040281 None] Acquiring lock "cinder-c35530ce-dd07-4c9b-afa2-5edfa7ac7849-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:07 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9c6215a4-60ca-4965-936d-1302223fcdd2 tempest-SnapshotsActionsTest-1458040281 None] Lock "cinder-c35530ce-dd07-4c9b-afa2-5edfa7ac7849-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:07 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9c6215a4-60ca-4965-936d-1302223fcdd2 tempest-SnapshotsActionsTest-1458040281 None] Acquiring lock "cinder-quobyte-c35530ce-dd07-4c9b-afa2-5edfa7ac7849" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:07 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9c6215a4-60ca-4965-936d-1302223fcdd2 tempest-SnapshotsActionsTest-1458040281 None] Lock "cinder-quobyte-c35530ce-dd07-4c9b-afa2-5edfa7ac7849" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:07 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[e919aad7-623c-4829-adda-fccf4cf347f6]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:43:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9c6215a4-60ca-4965-936d-1302223fcdd2 tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:07 devstack sudo[86018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849 Apr 16 19:43:07 devstack sudo[86018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:08 devstack sudo[86018]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9c6215a4-60ca-4965-936d-1302223fcdd2 tempest-SnapshotsActionsTest-1458040281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849" returned: 0 in 0.688s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9c6215a4-60ca-4965-936d-1302223fcdd2 tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:08 devstack sudo[86024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849 Apr 16 19:43:08 devstack sudo[86024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:09 devstack sudo[86024]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Flow 'volume_create_manager' (0f130582-9e60-469f-a5b4-d693d2973e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e082afd2-2017-4e42-b5a8-e4bc82625a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9c6215a4-60ca-4965-936d-1302223fcdd2 tempest-SnapshotsActionsTest-1458040281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c35530ce-dd07-4c9b-afa2-5edfa7ac7849" returned: 0 in 0.595s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e082afd2-2017-4e42-b5a8-e4bc82625a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-948060123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cfea914-df41-454e-8e27-8382c0b17f08,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76e2aee7bab84542901b743316018ce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:09Z,use_quota=True,user_id='15c42e23da424e708daaefa630966b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ee4aee-7d2b-4a1d-9195-bf29934aa778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ee4aee-7d2b-4a1d-9195-bf29934aa778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03bcaa47-0c36-4700-8853-590a7b9fd6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03bcaa47-0c36-4700-8853-590a7b9fd6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cfea914-df41-454e-8e27-8382c0b17f08', 'volume_name': 'volume-1cfea914-df41-454e-8e27-8382c0b17f08', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f169df8-e84c-4d75-82c9-f01a140d1236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f169df8-e84c-4d75-82c9-f01a140d1236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da3d7ec-3c41-4dcc-98a3-3fb60556034d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:09 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Volume 1cfea914-df41-454e-8e27-8382c0b17f08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cfea914-df41-454e-8e27-8382c0b17f08', 'volume_size': 1} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-948060123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cfea914-df41-454e-8e27-8382c0b17f08,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76e2aee7bab84542901b743316018ce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:09Z,use_quota=True,user_id='15c42e23da424e708daaefa630966b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Creating volume 1cfea914-df41-454e-8e27-8382c0b17f08 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:43:09 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1cfea914-df41-454e-8e27-8382c0b17f08 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:09 devstack sudo[86030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1cfea914-df41-454e-8e27-8382c0b17f08 1073741824 Apr 16 19:43:09 devstack sudo[86030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9c6215a4-60ca-4965-936d-1302223fcdd2 tempest-SnapshotsActionsTest-1458040281 None] Lock "cinder-quobyte-c35530ce-dd07-4c9b-afa2-5edfa7ac7849" released by "delete_volume" :: held 1.395s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-9c6215a4-60ca-4965-936d-1302223fcdd2 tempest-SnapshotsActionsTest-1458040281 None] Created reservations ['25168ef0-45d2-499a-93a5-f837535eb138', '6be8736f-1145-4f4f-a10b-99d5b8dcd05d', '0b302e8c-1ab3-4b21-af35-f5a5b00a5235', '10068841-4809-4688-a763-32da8ab094f9'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9c6215a4-60ca-4965-936d-1302223fcdd2 tempest-SnapshotsActionsTest-1458040281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9c6215a4-60ca-4965-936d-1302223fcdd2 tempest-SnapshotsActionsTest-1458040281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-9c6215a4-60ca-4965-936d-1302223fcdd2 tempest-SnapshotsActionsTest-1458040281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-9c6215a4-60ca-4965-936d-1302223fcdd2 tempest-SnapshotsActionsTest-1458040281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9c6215a4-60ca-4965-936d-1302223fcdd2 tempest-SnapshotsActionsTest-1458040281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9c6215a4-60ca-4965-936d-1302223fcdd2 tempest-SnapshotsActionsTest-1458040281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:09 devstack sudo[86032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:43:09 devstack sudo[86032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:09 devstack sudo[86030]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1cfea914-df41-454e-8e27-8382c0b17f08 1073741824" returned: 0 in 0.733s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1cfea914-df41-454e-8e27-8382c0b17f08 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:09 devstack sudo[86032]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9c6215a4-60ca-4965-936d-1302223fcdd2 tempest-SnapshotsActionsTest-1458040281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.685s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:09 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-9c6215a4-60ca-4965-936d-1302223fcdd2 tempest-SnapshotsActionsTest-1458040281 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:43:09 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-9c6215a4-60ca-4965-936d-1302223fcdd2 tempest-SnapshotsActionsTest-1458040281 None] Deleted volume successfully. Apr 16 19:43:10 devstack sudo[86061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1cfea914-df41-454e-8e27-8382c0b17f08 Apr 16 19:43:10 devstack sudo[86061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:10 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9c6215a4-60ca-4965-936d-1302223fcdd2 tempest-SnapshotsActionsTest-1458040281 None] Lock "cinder-c35530ce-dd07-4c9b-afa2-5edfa7ac7849-delete_volume" released by "delete_volume" :: held 2.264s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:10 devstack sudo[86061]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1cfea914-df41-454e-8e27-8382c0b17f08" returned: 0 in 0.690s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:10 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:43:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da3d7ec-3c41-4dcc-98a3-3fb60556034d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cfea914-df41-454e-8e27-8382c0b17f08', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a984ba1-dd1a-4860-92a1-b45a622b11c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:10 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Volume volume-1cfea914-df41-454e-8e27-8382c0b17f08 (1cfea914-df41-454e-8e27-8382c0b17f08): created successfully Apr 16 19:43:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a984ba1-dd1a-4860-92a1-b45a622b11c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Flow 'volume_create_manager' (0f130582-9e60-469f-a5b4-d693d2973e11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:10 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-7f4a2554-ede7-4745-aa3e-12f23df99a60 tempest-VolumesListTestJSON-1344037123 None] Created volume successfully. Apr 16 19:43:11 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:43:11 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Flow 'volume_create_manager' (f481468d-db56-463b-85bd-923203e9c2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:11 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2804d6f-55fb-492b-a363-aa830ec29c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:11 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2804d6f-55fb-492b-a363-aa830ec29c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2010926622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d63b2cb-583c-4fa2-93d2-443d332bd161,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76e2aee7bab84542901b743316018ce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:12Z,use_quota=True,user_id='15c42e23da424e708daaefa630966b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:11 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c17d8c18-c3c9-42bd-a365-eb731cb9ac11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:11 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c17d8c18-c3c9-42bd-a365-eb731cb9ac11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:11 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c84a57-44f8-433c-aae1-6c7b2a2b033d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:11 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c84a57-44f8-433c-aae1-6c7b2a2b033d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d63b2cb-583c-4fa2-93d2-443d332bd161', 'volume_name': 'volume-7d63b2cb-583c-4fa2-93d2-443d332bd161', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:11 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77669a5c-143c-48d3-9454-d360a2a6712f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:11 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77669a5c-143c-48d3-9454-d360a2a6712f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:11 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98458dd8-338d-4e75-af4b-0c45a2b5af1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:11 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Volume 7d63b2cb-583c-4fa2-93d2-443d332bd161: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d63b2cb-583c-4fa2-93d2-443d332bd161', 'volume_size': 1} Apr 16 19:43:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:11 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2010926622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d63b2cb-583c-4fa2-93d2-443d332bd161,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76e2aee7bab84542901b743316018ce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:12Z,use_quota=True,user_id='15c42e23da424e708daaefa630966b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:43:11 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Creating volume 7d63b2cb-583c-4fa2-93d2-443d332bd161 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:43:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:11 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:11 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:11 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:43:11 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:43:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7d63b2cb-583c-4fa2-93d2-443d332bd161 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:11 devstack sudo[86130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7d63b2cb-583c-4fa2-93d2-443d332bd161 1073741824 Apr 16 19:43:11 devstack sudo[86130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:12 devstack sudo[86130]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7d63b2cb-583c-4fa2-93d2-443d332bd161 1073741824" returned: 0 in 0.698s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7d63b2cb-583c-4fa2-93d2-443d332bd161 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:12 devstack sudo[86137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7d63b2cb-583c-4fa2-93d2-443d332bd161 Apr 16 19:43:12 devstack sudo[86137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:13 devstack sudo[86137]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7d63b2cb-583c-4fa2-93d2-443d332bd161" returned: 0 in 0.549s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:13 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:43:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98458dd8-338d-4e75-af4b-0c45a2b5af1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d63b2cb-583c-4fa2-93d2-443d332bd161', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd22dec4-71f2-46b8-a873-f57c3717da02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:13 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Volume volume-7d63b2cb-583c-4fa2-93d2-443d332bd161 (7d63b2cb-583c-4fa2-93d2-443d332bd161): created successfully Apr 16 19:43:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd22dec4-71f2-46b8-a873-f57c3717da02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Flow 'volume_create_manager' (f481468d-db56-463b-85bd-923203e9c2c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:13 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-0fc9b29b-d62b-4ccf-a88b-ec3781494963 tempest-VolumesListTestJSON-1344037123 None] Created volume successfully. Apr 16 19:43:14 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:43:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Flow 'volume_create_manager' (d213a217-56a5-4b07-a2f0-a1f571e51a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f84156-9d34-4d1f-8ac1-6c0963209476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f84156-9d34-4d1f-8ac1-6c0963209476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1844569832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2d9128e-8f21-4a00-a086-58b957d786bb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76e2aee7bab84542901b743316018ce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:14Z,use_quota=True,user_id='15c42e23da424e708daaefa630966b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc1f443-fefb-4020-8fde-179884f14197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc1f443-fefb-4020-8fde-179884f14197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe2b2f21-d519-4d6f-948f-3638fb0107b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe2b2f21-d519-4d6f-948f-3638fb0107b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2d9128e-8f21-4a00-a086-58b957d786bb', 'volume_name': 'volume-a2d9128e-8f21-4a00-a086-58b957d786bb', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bbe2197-c16a-4402-8e43-82379bd99d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bbe2197-c16a-4402-8e43-82379bd99d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a78f468e-f29b-45a3-86cf-a80460bada75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:14 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Volume a2d9128e-8f21-4a00-a086-58b957d786bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2d9128e-8f21-4a00-a086-58b957d786bb', 'volume_size': 1} Apr 16 19:43:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1844569832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2d9128e-8f21-4a00-a086-58b957d786bb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76e2aee7bab84542901b743316018ce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:14Z,use_quota=True,user_id='15c42e23da424e708daaefa630966b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:43:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Creating volume a2d9128e-8f21-4a00-a086-58b957d786bb {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:43:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:43:14 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:43:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a2d9128e-8f21-4a00-a086-58b957d786bb 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:14 devstack sudo[86141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a2d9128e-8f21-4a00-a086-58b957d786bb 1073741824 Apr 16 19:43:14 devstack sudo[86141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:14 devstack sudo[86141]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a2d9128e-8f21-4a00-a086-58b957d786bb 1073741824" returned: 0 in 0.655s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a2d9128e-8f21-4a00-a086-58b957d786bb {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:15 devstack sudo[86146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a2d9128e-8f21-4a00-a086-58b957d786bb Apr 16 19:43:15 devstack sudo[86146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:15 devstack sudo[86146]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a2d9128e-8f21-4a00-a086-58b957d786bb" returned: 0 in 0.606s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:15 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:43:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:15 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a78f468e-f29b-45a3-86cf-a80460bada75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2d9128e-8f21-4a00-a086-58b957d786bb', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:15 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e1f377-b5e7-4133-9920-72a26ba4d516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:15 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Volume volume-a2d9128e-8f21-4a00-a086-58b957d786bb (a2d9128e-8f21-4a00-a086-58b957d786bb): created successfully Apr 16 19:43:15 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e1f377-b5e7-4133-9920-72a26ba4d516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:15 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Flow 'volume_create_manager' (d213a217-56a5-4b07-a2f0-a1f571e51a1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:15 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-3b99c767-1db1-4c45-a271-dcb1704094cf tempest-VolumesListTestJSON-1344037123 None] Created volume successfully. Apr 16 19:43:18 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-8ec130de-3326-4819-97fd-26524a83c58e tempest-VolumesListTestJSON-1344037123 None] Acquiring lock "cinder-a2d9128e-8f21-4a00-a086-58b957d786bb-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:18 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-8ec130de-3326-4819-97fd-26524a83c58e tempest-VolumesListTestJSON-1344037123 None] Lock "cinder-a2d9128e-8f21-4a00-a086-58b957d786bb-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:18 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-8ec130de-3326-4819-97fd-26524a83c58e tempest-VolumesListTestJSON-1344037123 None] Acquiring lock "cinder-quobyte-a2d9128e-8f21-4a00-a086-58b957d786bb" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:18 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-8ec130de-3326-4819-97fd-26524a83c58e tempest-VolumesListTestJSON-1344037123 None] Lock "cinder-quobyte-a2d9128e-8f21-4a00-a086-58b957d786bb" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:18 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fb8da2-f7ae-4699-8115-b9fcdec27ffc]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:43:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8ec130de-3326-4819-97fd-26524a83c58e tempest-VolumesListTestJSON-1344037123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a2d9128e-8f21-4a00-a086-58b957d786bb {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:18 devstack sudo[86152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a2d9128e-8f21-4a00-a086-58b957d786bb Apr 16 19:43:18 devstack sudo[86152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:19 devstack sudo[86152]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8ec130de-3326-4819-97fd-26524a83c58e tempest-VolumesListTestJSON-1344037123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a2d9128e-8f21-4a00-a086-58b957d786bb" returned: 0 in 0.620s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8ec130de-3326-4819-97fd-26524a83c58e tempest-VolumesListTestJSON-1344037123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a2d9128e-8f21-4a00-a086-58b957d786bb {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:19 devstack sudo[86157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a2d9128e-8f21-4a00-a086-58b957d786bb Apr 16 19:43:19 devstack sudo[86157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:19 devstack sudo[86157]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8ec130de-3326-4819-97fd-26524a83c58e tempest-VolumesListTestJSON-1344037123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a2d9128e-8f21-4a00-a086-58b957d786bb" returned: 0 in 0.635s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:19 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-8ec130de-3326-4819-97fd-26524a83c58e tempest-VolumesListTestJSON-1344037123 None] Lock "cinder-quobyte-a2d9128e-8f21-4a00-a086-58b957d786bb" released by "delete_volume" :: held 1.285s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-8ec130de-3326-4819-97fd-26524a83c58e tempest-VolumesListTestJSON-1344037123 None] Created reservations ['47b6d262-084c-47be-bab1-de90af4a25a2', '17c95714-33a4-43d5-ac3b-ebe5a2d4a94f', 'c302454c-72ce-4c27-9785-41aacc95c809', '16fa25b7-dd3f-4bdf-ac74-79d3b23d3783'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-8ec130de-3326-4819-97fd-26524a83c58e tempest-VolumesListTestJSON-1344037123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-8ec130de-3326-4819-97fd-26524a83c58e tempest-VolumesListTestJSON-1344037123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-8ec130de-3326-4819-97fd-26524a83c58e tempest-VolumesListTestJSON-1344037123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-8ec130de-3326-4819-97fd-26524a83c58e tempest-VolumesListTestJSON-1344037123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-8ec130de-3326-4819-97fd-26524a83c58e tempest-VolumesListTestJSON-1344037123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8ec130de-3326-4819-97fd-26524a83c58e tempest-VolumesListTestJSON-1344037123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:20 devstack sudo[86160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:43:20 devstack sudo[86160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:20 devstack sudo[86160]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8ec130de-3326-4819-97fd-26524a83c58e tempest-VolumesListTestJSON-1344037123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.728s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-8ec130de-3326-4819-97fd-26524a83c58e tempest-VolumesListTestJSON-1344037123 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:43:20 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-8ec130de-3326-4819-97fd-26524a83c58e tempest-VolumesListTestJSON-1344037123 None] Deleted volume successfully. Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-8ec130de-3326-4819-97fd-26524a83c58e tempest-VolumesListTestJSON-1344037123 None] Lock "cinder-a2d9128e-8f21-4a00-a086-58b957d786bb-delete_volume" released by "delete_volume" :: held 2.202s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Flow 'volume_create_manager' (522d14c4-905d-499a-bc02-1c5e56c3a11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d87d44-c296-4ffd-bbb1-0a0a73b72b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d87d44-c296-4ffd-bbb1-0a0a73b72b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1669821615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc4f7c7-9a56-409b-b059-16ab447611f0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1788928528df4d4a8d7ed985d2ba8151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:21Z,use_quota=True,user_id='f0e3ee45f5454cdfa8278832ed169d17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f552aa-cacb-4790-afb9-31335cbd6ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f552aa-cacb-4790-afb9-31335cbd6ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb40f343-f5d1-4d0b-9962-ea100c498018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb40f343-f5d1-4d0b-9962-ea100c498018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fc4f7c7-9a56-409b-b059-16ab447611f0', 'volume_name': 'volume-6fc4f7c7-9a56-409b-b059-16ab447611f0', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (024a00ce-7fb5-4022-8abd-53ecf2a60f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (024a00ce-7fb5-4022-8abd-53ecf2a60f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f050d5b1-0c1f-4c98-aee9-5f19d86f0861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:20 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Volume 6fc4f7c7-9a56-409b-b059-16ab447611f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fc4f7c7-9a56-409b-b059-16ab447611f0', 'volume_size': 1} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1669821615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc4f7c7-9a56-409b-b059-16ab447611f0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1788928528df4d4a8d7ed985d2ba8151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:21Z,use_quota=True,user_id='f0e3ee45f5454cdfa8278832ed169d17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Creating volume 6fc4f7c7-9a56-409b-b059-16ab447611f0 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:43:20 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6fc4f7c7-9a56-409b-b059-16ab447611f0 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:20 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-02ac78bc-dbd8-419d-807a-31a5d66cb4a0 tempest-VolumesListTestJSON-1344037123 None] Acquiring lock "cinder-7d63b2cb-583c-4fa2-93d2-443d332bd161-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:21 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-02ac78bc-dbd8-419d-807a-31a5d66cb4a0 tempest-VolumesListTestJSON-1344037123 None] Lock "cinder-7d63b2cb-583c-4fa2-93d2-443d332bd161-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:21 devstack sudo[86164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6fc4f7c7-9a56-409b-b059-16ab447611f0 1073741824 Apr 16 19:43:21 devstack sudo[86164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:21 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-02ac78bc-dbd8-419d-807a-31a5d66cb4a0 tempest-VolumesListTestJSON-1344037123 None] Acquiring lock "cinder-quobyte-7d63b2cb-583c-4fa2-93d2-443d332bd161" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:21 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-02ac78bc-dbd8-419d-807a-31a5d66cb4a0 tempest-VolumesListTestJSON-1344037123 None] Lock "cinder-quobyte-7d63b2cb-583c-4fa2-93d2-443d332bd161" acquired by "delete_volume" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:21 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[36908a76-d818-4f43-88a8-32a880886341]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:43:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-02ac78bc-dbd8-419d-807a-31a5d66cb4a0 tempest-VolumesListTestJSON-1344037123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7d63b2cb-583c-4fa2-93d2-443d332bd161 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:21 devstack sudo[86166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7d63b2cb-583c-4fa2-93d2-443d332bd161 Apr 16 19:43:21 devstack sudo[86166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:21 devstack sudo[86164]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6fc4f7c7-9a56-409b-b059-16ab447611f0 1073741824" returned: 0 in 0.702s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:21 devstack sudo[86166]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-02ac78bc-dbd8-419d-807a-31a5d66cb4a0 tempest-VolumesListTestJSON-1344037123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7d63b2cb-583c-4fa2-93d2-443d332bd161" returned: 0 in 0.636s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-02ac78bc-dbd8-419d-807a-31a5d66cb4a0 tempest-VolumesListTestJSON-1344037123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7d63b2cb-583c-4fa2-93d2-443d332bd161 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:21 devstack sudo[86174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7d63b2cb-583c-4fa2-93d2-443d332bd161 Apr 16 19:43:21 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6fc4f7c7-9a56-409b-b059-16ab447611f0 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:21 devstack sudo[86176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6fc4f7c7-9a56-409b-b059-16ab447611f0 Apr 16 19:43:21 devstack sudo[86176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:22 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-02ac78bc-dbd8-419d-807a-31a5d66cb4a0 tempest-VolumesListTestJSON-1344037123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7d63b2cb-583c-4fa2-93d2-443d332bd161" returned: 0 in 0.535s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:22 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-02ac78bc-dbd8-419d-807a-31a5d66cb4a0 tempest-VolumesListTestJSON-1344037123 None] Lock "cinder-quobyte-7d63b2cb-583c-4fa2-93d2-443d332bd161" released by "delete_volume" :: held 1.202s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:22 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-02ac78bc-dbd8-419d-807a-31a5d66cb4a0 tempest-VolumesListTestJSON-1344037123 None] Created reservations ['ec05c2fb-459a-4be0-8e14-5b764c327f3c', '9412b0ac-a441-4777-a508-00513856466c', '6890d52f-d8a9-4a25-92eb-6d3de7a7955a', '60321d84-8628-48fc-8f4c-8fa7dc95c381'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:43:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-02ac78bc-dbd8-419d-807a-31a5d66cb4a0 tempest-VolumesListTestJSON-1344037123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-02ac78bc-dbd8-419d-807a-31a5d66cb4a0 tempest-VolumesListTestJSON-1344037123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:22 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-02ac78bc-dbd8-419d-807a-31a5d66cb4a0 tempest-VolumesListTestJSON-1344037123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:22 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-02ac78bc-dbd8-419d-807a-31a5d66cb4a0 tempest-VolumesListTestJSON-1344037123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-02ac78bc-dbd8-419d-807a-31a5d66cb4a0 tempest-VolumesListTestJSON-1344037123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-02ac78bc-dbd8-419d-807a-31a5d66cb4a0 tempest-VolumesListTestJSON-1344037123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:22 devstack sudo[86176]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6fc4f7c7-9a56-409b-b059-16ab447611f0" returned: 0 in 0.685s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:22 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:43:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:22 devstack sudo[86180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:43:22 devstack sudo[86180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f050d5b1-0c1f-4c98-aee9-5f19d86f0861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fc4f7c7-9a56-409b-b059-16ab447611f0', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376dc0c8-7496-4372-8ad0-89c51e703c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:22 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Volume volume-6fc4f7c7-9a56-409b-b059-16ab447611f0 (6fc4f7c7-9a56-409b-b059-16ab447611f0): created successfully Apr 16 19:43:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376dc0c8-7496-4372-8ad0-89c51e703c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Flow 'volume_create_manager' (522d14c4-905d-499a-bc02-1c5e56c3a11b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:22 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-4c71a8d2-4eed-4a4f-8d12-0ff09a441814 tempest-VolumesTestJSON-1834033160 None] Created volume successfully. Apr 16 19:43:22 devstack sudo[86180]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-02ac78bc-dbd8-419d-807a-31a5d66cb4a0 tempest-VolumesListTestJSON-1344037123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.496s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:22 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-02ac78bc-dbd8-419d-807a-31a5d66cb4a0 tempest-VolumesListTestJSON-1344037123 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:43:22 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-02ac78bc-dbd8-419d-807a-31a5d66cb4a0 tempest-VolumesListTestJSON-1344037123 None] Deleted volume successfully. Apr 16 19:43:22 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-02ac78bc-dbd8-419d-807a-31a5d66cb4a0 tempest-VolumesListTestJSON-1344037123 None] Lock "cinder-7d63b2cb-583c-4fa2-93d2-443d332bd161-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d05b27b8-66dd-4674-a657-893199765ad6 tempest-VolumesListTestJSON-1344037123 None] Acquiring lock "cinder-1cfea914-df41-454e-8e27-8382c0b17f08-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d05b27b8-66dd-4674-a657-893199765ad6 tempest-VolumesListTestJSON-1344037123 None] Lock "cinder-1cfea914-df41-454e-8e27-8382c0b17f08-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d05b27b8-66dd-4674-a657-893199765ad6 tempest-VolumesListTestJSON-1344037123 None] Acquiring lock "cinder-quobyte-1cfea914-df41-454e-8e27-8382c0b17f08" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d05b27b8-66dd-4674-a657-893199765ad6 tempest-VolumesListTestJSON-1344037123 None] Lock "cinder-quobyte-1cfea914-df41-454e-8e27-8382c0b17f08" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a30fca-2d10-465c-979e-8dd329301c91]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d05b27b8-66dd-4674-a657-893199765ad6 tempest-VolumesListTestJSON-1344037123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1cfea914-df41-454e-8e27-8382c0b17f08 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Flow 'volume_create_manager' (b092c218-190c-4ebd-bea2-de232a2ad054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:23 devstack sudo[86184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1cfea914-df41-454e-8e27-8382c0b17f08 Apr 16 19:43:23 devstack sudo[86184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a44356-2e17-44f0-a47e-32bd5f7a22ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a44356-2e17-44f0-a47e-32bd5f7a22ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-196663160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e67b54c-2206-4e9a-bce1-0631a6dbec7e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1788928528df4d4a8d7ed985d2ba8151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:23Z,use_quota=True,user_id='f0e3ee45f5454cdfa8278832ed169d17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ab4409-c50a-4bcf-a0ef-9f1d5e8b4ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ab4409-c50a-4bcf-a0ef-9f1d5e8b4ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0cb8824-8b44-4a25-b5d5-f1d68048ec41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0cb8824-8b44-4a25-b5d5-f1d68048ec41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e67b54c-2206-4e9a-bce1-0631a6dbec7e', 'volume_name': 'volume-9e67b54c-2206-4e9a-bce1-0631a6dbec7e', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f75a0416-459c-4687-b31f-cdfb2c9ace47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f75a0416-459c-4687-b31f-cdfb2c9ace47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c93815-b110-4e02-b2c3-fa9f66c3c14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:23 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Volume 9e67b54c-2206-4e9a-bce1-0631a6dbec7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e67b54c-2206-4e9a-bce1-0631a6dbec7e', 'volume_size': 1} Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-196663160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e67b54c-2206-4e9a-bce1-0631a6dbec7e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1788928528df4d4a8d7ed985d2ba8151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:23Z,use_quota=True,user_id='f0e3ee45f5454cdfa8278832ed169d17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Creating volume 9e67b54c-2206-4e9a-bce1-0631a6dbec7e {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:43:23 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:43:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-9e67b54c-2206-4e9a-bce1-0631a6dbec7e 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:23 devstack sudo[86186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-9e67b54c-2206-4e9a-bce1-0631a6dbec7e 1073741824 Apr 16 19:43:23 devstack sudo[86186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:24 devstack sudo[86184]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d05b27b8-66dd-4674-a657-893199765ad6 tempest-VolumesListTestJSON-1344037123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1cfea914-df41-454e-8e27-8382c0b17f08" returned: 0 in 0.705s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d05b27b8-66dd-4674-a657-893199765ad6 tempest-VolumesListTestJSON-1344037123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1cfea914-df41-454e-8e27-8382c0b17f08 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:24 devstack sudo[86194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1cfea914-df41-454e-8e27-8382c0b17f08 Apr 16 19:43:24 devstack sudo[86194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:24 devstack sudo[86186]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-9e67b54c-2206-4e9a-bce1-0631a6dbec7e 1073741824" returned: 0 in 0.651s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-9e67b54c-2206-4e9a-bce1-0631a6dbec7e {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:24 devstack sudo[86196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-9e67b54c-2206-4e9a-bce1-0631a6dbec7e Apr 16 19:43:24 devstack sudo[86196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Flow 'volume_create_manager' (8f88ea55-0738-4a5d-ad0f-7bdeb7e8c723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd95bd75-560d-44e9-abd4-a92f93d22c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd95bd75-560d-44e9-abd4-a92f93d22c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1014493097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09fa2b67-d23a-4b85-bbfc-15f68216620b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070b099e0faa4e8a9ab98ddfe2b82263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:24Z,use_quota=True,user_id='3d48455d5d194c318fc1264f726db879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db509fa0-2679-490f-a455-4448ec2bea7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db509fa0-2679-490f-a455-4448ec2bea7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df4d6de9-4749-4dd8-a3a2-8a0d20af7580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df4d6de9-4749-4dd8-a3a2-8a0d20af7580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09fa2b67-d23a-4b85-bbfc-15f68216620b', 'volume_name': 'volume-09fa2b67-d23a-4b85-bbfc-15f68216620b', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaf0d05d-4849-46be-96ba-5c6d72146c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaf0d05d-4849-46be-96ba-5c6d72146c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6fc232b-d6c6-467d-befa-bf23571201bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:24 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Volume 09fa2b67-d23a-4b85-bbfc-15f68216620b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09fa2b67-d23a-4b85-bbfc-15f68216620b', 'volume_size': 1} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:24 devstack sudo[86194]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d05b27b8-66dd-4674-a657-893199765ad6 tempest-VolumesListTestJSON-1344037123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1cfea914-df41-454e-8e27-8382c0b17f08" returned: 0 in 0.533s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d05b27b8-66dd-4674-a657-893199765ad6 tempest-VolumesListTestJSON-1344037123 None] Lock "cinder-quobyte-1cfea914-df41-454e-8e27-8382c0b17f08" released by "delete_volume" :: held 1.281s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-d05b27b8-66dd-4674-a657-893199765ad6 tempest-VolumesListTestJSON-1344037123 None] Created reservations ['ea021ba1-5926-4895-b647-eb6fafe60681', '635026f0-7745-4aa2-9309-327ce1a5f065', '2be6cfb1-76db-4069-bdac-2ecfab01520d', '45c3d421-53e7-4530-8cba-412e1786e0a1'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d05b27b8-66dd-4674-a657-893199765ad6 tempest-VolumesListTestJSON-1344037123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d05b27b8-66dd-4674-a657-893199765ad6 tempest-VolumesListTestJSON-1344037123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d05b27b8-66dd-4674-a657-893199765ad6 tempest-VolumesListTestJSON-1344037123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d05b27b8-66dd-4674-a657-893199765ad6 tempest-VolumesListTestJSON-1344037123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d05b27b8-66dd-4674-a657-893199765ad6 tempest-VolumesListTestJSON-1344037123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d05b27b8-66dd-4674-a657-893199765ad6 tempest-VolumesListTestJSON-1344037123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:24 devstack sudo[86199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:43:24 devstack sudo[86199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:24 devstack sudo[86196]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-9e67b54c-2206-4e9a-bce1-0631a6dbec7e" returned: 0 in 0.549s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.414s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1014493097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09fa2b67-d23a-4b85-bbfc-15f68216620b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070b099e0faa4e8a9ab98ddfe2b82263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:24Z,use_quota=True,user_id='3d48455d5d194c318fc1264f726db879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Creating volume 09fa2b67-d23a-4b85-bbfc-15f68216620b {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:43:24 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-09fa2b67-d23a-4b85-bbfc-15f68216620b 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c93815-b110-4e02-b2c3-fa9f66c3c14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e67b54c-2206-4e9a-bce1-0631a6dbec7e', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:24 devstack sudo[86202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-09fa2b67-d23a-4b85-bbfc-15f68216620b 1073741824 Apr 16 19:43:24 devstack sudo[86202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0444c0b4-4d0e-439f-a31d-23ee5e92fd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:24 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Volume volume-9e67b54c-2206-4e9a-bce1-0631a6dbec7e (9e67b54c-2206-4e9a-bce1-0631a6dbec7e): created successfully Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0444c0b4-4d0e-439f-a31d-23ee5e92fd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Flow 'volume_create_manager' (b092c218-190c-4ebd-bea2-de232a2ad054) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:24 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-cc9e8057-b0db-418e-892e-ec336e22a2de tempest-VolumesTestJSON-1834033160 None] Created volume successfully. Apr 16 19:43:25 devstack sudo[86199]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d05b27b8-66dd-4674-a657-893199765ad6 tempest-VolumesListTestJSON-1344037123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.523s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:25 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-d05b27b8-66dd-4674-a657-893199765ad6 tempest-VolumesListTestJSON-1344037123 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:43:25 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-d05b27b8-66dd-4674-a657-893199765ad6 tempest-VolumesListTestJSON-1344037123 None] Deleted volume successfully. Apr 16 19:43:25 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d05b27b8-66dd-4674-a657-893199765ad6 tempest-VolumesListTestJSON-1344037123 None] Lock "cinder-1cfea914-df41-454e-8e27-8382c0b17f08-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:25 devstack sudo[86202]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-09fa2b67-d23a-4b85-bbfc-15f68216620b 1073741824" returned: 0 in 0.589s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-09fa2b67-d23a-4b85-bbfc-15f68216620b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:25 devstack sudo[86208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-09fa2b67-d23a-4b85-bbfc-15f68216620b Apr 16 19:43:25 devstack sudo[86208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Flow 'volume_create_manager' (82b79a81-a481-43e2-9d11-ed53a1afdf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (455277c5-a93c-4798-9f94-8d1db4242cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (455277c5-a93c-4798-9f94-8d1db4242cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1353534203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb3e5f02-faeb-47ae-88d6-8d128a8e7330,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1788928528df4d4a8d7ed985d2ba8151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:26Z,use_quota=True,user_id='f0e3ee45f5454cdfa8278832ed169d17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b172ca-fb46-435a-82e8-c2adfa9017aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b172ca-fb46-435a-82e8-c2adfa9017aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49aadaad-135c-4389-82d4-cf8afbbcedf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49aadaad-135c-4389-82d4-cf8afbbcedf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb3e5f02-faeb-47ae-88d6-8d128a8e7330', 'volume_name': 'volume-cb3e5f02-faeb-47ae-88d6-8d128a8e7330', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:26 devstack sudo[86208]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3adbb2a7-4564-4fc0-9be8-71de326c0614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3adbb2a7-4564-4fc0-9be8-71de326c0614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a05cbf49-3156-42d1-9160-98a0a6a127c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:26 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Volume cb3e5f02-faeb-47ae-88d6-8d128a8e7330: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb3e5f02-faeb-47ae-88d6-8d128a8e7330', 'volume_size': 1} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-09fa2b67-d23a-4b85-bbfc-15f68216620b" returned: 0 in 0.560s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1353534203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb3e5f02-faeb-47ae-88d6-8d128a8e7330,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1788928528df4d4a8d7ed985d2ba8151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:26Z,use_quota=True,user_id='f0e3ee45f5454cdfa8278832ed169d17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Creating volume cb3e5f02-faeb-47ae-88d6-8d128a8e7330 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:43:26 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-cb3e5f02-faeb-47ae-88d6-8d128a8e7330 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6fc232b-d6c6-467d-befa-bf23571201bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09fa2b67-d23a-4b85-bbfc-15f68216620b', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e781b0a1-3ac5-4de5-881d-f5b06120c6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:26 devstack sudo[86211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-cb3e5f02-faeb-47ae-88d6-8d128a8e7330 1073741824 Apr 16 19:43:26 devstack sudo[86211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:26 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Volume volume-09fa2b67-d23a-4b85-bbfc-15f68216620b (09fa2b67-d23a-4b85-bbfc-15f68216620b): created successfully Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e781b0a1-3ac5-4de5-881d-f5b06120c6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Flow 'volume_create_manager' (8f88ea55-0738-4a5d-ad0f-7bdeb7e8c723) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:26 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-ddf7d9dc-2292-42f5-9b41-fcd78e982096 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Created volume successfully. Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a8d3d2f4-dad7-4c34-a98e-a737969c9ab4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Acquiring lock "cinder-09fa2b67-d23a-4b85-bbfc-15f68216620b-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a8d3d2f4-dad7-4c34-a98e-a737969c9ab4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Lock "cinder-09fa2b67-d23a-4b85-bbfc-15f68216620b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a8d3d2f4-dad7-4c34-a98e-a737969c9ab4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Acquiring lock "cinder-quobyte-09fa2b67-d23a-4b85-bbfc-15f68216620b" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a8d3d2f4-dad7-4c34-a98e-a737969c9ab4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Lock "cinder-quobyte-09fa2b67-d23a-4b85-bbfc-15f68216620b" acquired by "delete_volume" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[46629e31-b5bc-438e-8744-ec24cb96af8b]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a8d3d2f4-dad7-4c34-a98e-a737969c9ab4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-09fa2b67-d23a-4b85-bbfc-15f68216620b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:26 devstack sudo[86216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-09fa2b67-d23a-4b85-bbfc-15f68216620b Apr 16 19:43:26 devstack sudo[86216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:26 devstack sudo[86211]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-cb3e5f02-faeb-47ae-88d6-8d128a8e7330 1073741824" returned: 0 in 0.755s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-cb3e5f02-faeb-47ae-88d6-8d128a8e7330 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:26 devstack sudo[86218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-cb3e5f02-faeb-47ae-88d6-8d128a8e7330 Apr 16 19:43:26 devstack sudo[86218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:27 devstack sudo[86216]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a8d3d2f4-dad7-4c34-a98e-a737969c9ab4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-09fa2b67-d23a-4b85-bbfc-15f68216620b" returned: 0 in 0.605s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a8d3d2f4-dad7-4c34-a98e-a737969c9ab4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-09fa2b67-d23a-4b85-bbfc-15f68216620b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:27 devstack sudo[86224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-09fa2b67-d23a-4b85-bbfc-15f68216620b Apr 16 19:43:27 devstack sudo[86224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:27 devstack sudo[86218]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-cb3e5f02-faeb-47ae-88d6-8d128a8e7330" returned: 0 in 0.567s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:27 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:43:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:27 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a05cbf49-3156-42d1-9160-98a0a6a127c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb3e5f02-faeb-47ae-88d6-8d128a8e7330', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:27 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4538c3-9827-4de3-8af0-e6af0622506c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:27 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Volume volume-cb3e5f02-faeb-47ae-88d6-8d128a8e7330 (cb3e5f02-faeb-47ae-88d6-8d128a8e7330): created successfully Apr 16 19:43:27 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4538c3-9827-4de3-8af0-e6af0622506c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:27 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Flow 'volume_create_manager' (82b79a81-a481-43e2-9d11-ed53a1afdf00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:27 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-33b6f541-5610-4908-b83f-686239367bdd tempest-VolumesTestJSON-1834033160 None] Created volume successfully. Apr 16 19:43:27 devstack sudo[86224]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a8d3d2f4-dad7-4c34-a98e-a737969c9ab4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-09fa2b67-d23a-4b85-bbfc-15f68216620b" returned: 0 in 0.561s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:27 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a8d3d2f4-dad7-4c34-a98e-a737969c9ab4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Lock "cinder-quobyte-09fa2b67-d23a-4b85-bbfc-15f68216620b" released by "delete_volume" :: held 1.194s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:27 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-a8d3d2f4-dad7-4c34-a98e-a737969c9ab4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Created reservations ['bc629782-ce19-484a-a892-6d262e5a3f6f', '3084b09a-b7e8-4484-a8d6-6a7f3b1466af', 'eb22d095-8ea7-4e5a-bee1-75a6424fc09c', '0d9ccafb-159e-4707-8e11-abe262a1bc70'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a8d3d2f4-dad7-4c34-a98e-a737969c9ab4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a8d3d2f4-dad7-4c34-a98e-a737969c9ab4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-a8d3d2f4-dad7-4c34-a98e-a737969c9ab4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-a8d3d2f4-dad7-4c34-a98e-a737969c9ab4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a8d3d2f4-dad7-4c34-a98e-a737969c9ab4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a8d3d2f4-dad7-4c34-a98e-a737969c9ab4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:43:28 devstack sudo[86227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:43:28 devstack sudo[86227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Flow 'volume_create_manager' (7553384a-a966-4c99-8674-63a32b896c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92a82f1-38b6-418f-8a5a-76bc55610c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92a82f1-38b6-418f-8a5a-76bc55610c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1023698347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=342fc080-ac73-4565-9087-1834af73b0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbfc00a50dc74f58aff48cc64736d5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:28Z,use_quota=True,user_id='6f84df46a21345ba9268beb62cc4ac92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d027e6e3-c541-41dd-aa57-cebbbe42a608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d027e6e3-c541-41dd-aa57-cebbbe42a608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d2f9ae-a94c-4d2e-8a39-bb9ecfafdb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d2f9ae-a94c-4d2e-8a39-bb9ecfafdb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '342fc080-ac73-4565-9087-1834af73b0ac', 'volume_name': 'volume-342fc080-ac73-4565-9087-1834af73b0ac', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2415916-8aa5-4031-a528-98019a715a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2415916-8aa5-4031-a528-98019a715a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75594a6a-b1a2-4248-9dbe-a2013953dce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:28 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Volume 342fc080-ac73-4565-9087-1834af73b0ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-342fc080-ac73-4565-9087-1834af73b0ac', 'volume_size': 1} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1023698347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=342fc080-ac73-4565-9087-1834af73b0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbfc00a50dc74f58aff48cc64736d5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:28Z,use_quota=True,user_id='6f84df46a21345ba9268beb62cc4ac92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Creating volume 342fc080-ac73-4565-9087-1834af73b0ac {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:43:28 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:28 devstack sudo[86229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac 1073741824 Apr 16 19:43:28 devstack sudo[86229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:28 devstack sudo[86227]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a8d3d2f4-dad7-4c34-a98e-a737969c9ab4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.596s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-a8d3d2f4-dad7-4c34-a98e-a737969c9ab4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:43:28 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-a8d3d2f4-dad7-4c34-a98e-a737969c9ab4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Deleted volume successfully. Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a8d3d2f4-dad7-4c34-a98e-a737969c9ab4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Lock "cinder-09fa2b67-d23a-4b85-bbfc-15f68216620b-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:28 devstack sudo[86229]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac 1073741824" returned: 0 in 0.675s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:28 devstack sudo[86235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac Apr 16 19:43:28 devstack sudo[86235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d5d2e442-79e4-4bc5-8b64-95943007a3e2 tempest-VolumesTestJSON-1834033160 None] Acquiring lock "cinder-cb3e5f02-faeb-47ae-88d6-8d128a8e7330-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:28 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d5d2e442-79e4-4bc5-8b64-95943007a3e2 tempest-VolumesTestJSON-1834033160 None] Lock "cinder-cb3e5f02-faeb-47ae-88d6-8d128a8e7330-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d5d2e442-79e4-4bc5-8b64-95943007a3e2 tempest-VolumesTestJSON-1834033160 None] Acquiring lock "cinder-quobyte-cb3e5f02-faeb-47ae-88d6-8d128a8e7330" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d5d2e442-79e4-4bc5-8b64-95943007a3e2 tempest-VolumesTestJSON-1834033160 None] Lock "cinder-quobyte-cb3e5f02-faeb-47ae-88d6-8d128a8e7330" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f1741d-7bbd-4b4f-92cc-ed3e6df0f598]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d5d2e442-79e4-4bc5-8b64-95943007a3e2 tempest-VolumesTestJSON-1834033160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-cb3e5f02-faeb-47ae-88d6-8d128a8e7330 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:29 devstack sudo[86237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-cb3e5f02-faeb-47ae-88d6-8d128a8e7330 Apr 16 19:43:29 devstack sudo[86237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Flow 'volume_create_manager' (af52ece1-741d-4fd5-98cd-ab08de5885f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119498dc-9c41-4fb9-8c4f-c22d3f807481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119498dc-9c41-4fb9-8c4f-c22d3f807481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1370072691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccaed553-5908-486c-ab19-e917cfc388fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070b099e0faa4e8a9ab98ddfe2b82263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:29Z,use_quota=True,user_id='3d48455d5d194c318fc1264f726db879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77bb3f74-a6c1-4c0d-b1ea-897465d5eb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77bb3f74-a6c1-4c0d-b1ea-897465d5eb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cbcd60b-9251-4223-b528-eb3bda34731f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cbcd60b-9251-4223-b528-eb3bda34731f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccaed553-5908-486c-ab19-e917cfc388fc', 'volume_name': 'volume-ccaed553-5908-486c-ab19-e917cfc388fc', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac0533f-87f3-4912-a681-d06e02794cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac0533f-87f3-4912-a681-d06e02794cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b25454-7ea3-48fa-9166-ae9bd8a82f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:29 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Volume ccaed553-5908-486c-ab19-e917cfc388fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccaed553-5908-486c-ab19-e917cfc388fc', 'volume_size': 1} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:29 devstack sudo[86235]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac" returned: 0 in 0.631s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.072s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1370072691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccaed553-5908-486c-ab19-e917cfc388fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070b099e0faa4e8a9ab98ddfe2b82263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:29Z,use_quota=True,user_id='3d48455d5d194c318fc1264f726db879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Creating volume ccaed553-5908-486c-ab19-e917cfc388fc {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:43:29 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ccaed553-5908-486c-ab19-e917cfc388fc 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75594a6a-b1a2-4248-9dbe-a2013953dce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-342fc080-ac73-4565-9087-1834af73b0ac', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e03fa37-d87d-47c3-9d74-0a423ad90b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:29 devstack sudo[86240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ccaed553-5908-486c-ab19-e917cfc388fc 1073741824 Apr 16 19:43:29 devstack sudo[86240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:29 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Volume volume-342fc080-ac73-4565-9087-1834af73b0ac (342fc080-ac73-4565-9087-1834af73b0ac): created successfully Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e03fa37-d87d-47c3-9d74-0a423ad90b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Flow 'volume_create_manager' (7553384a-a966-4c99-8674-63a32b896c7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:29 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-d2fc7038-80bb-4be9-986a-8e4d45a23d05 tempest-CreateVolumesFromSnapshotTest-881659188 None] Created volume successfully. Apr 16 19:43:29 devstack sudo[86237]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d5d2e442-79e4-4bc5-8b64-95943007a3e2 tempest-VolumesTestJSON-1834033160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-cb3e5f02-faeb-47ae-88d6-8d128a8e7330" returned: 0 in 0.628s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d5d2e442-79e4-4bc5-8b64-95943007a3e2 tempest-VolumesTestJSON-1834033160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-cb3e5f02-faeb-47ae-88d6-8d128a8e7330 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:29 devstack sudo[86245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-cb3e5f02-faeb-47ae-88d6-8d128a8e7330 Apr 16 19:43:29 devstack sudo[86245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:30 devstack sudo[86240]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ccaed553-5908-486c-ab19-e917cfc388fc 1073741824" returned: 0 in 0.623s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:30 devstack sudo[86245]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d5d2e442-79e4-4bc5-8b64-95943007a3e2 tempest-VolumesTestJSON-1834033160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-cb3e5f02-faeb-47ae-88d6-8d128a8e7330" returned: 0 in 0.484s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:30 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d5d2e442-79e4-4bc5-8b64-95943007a3e2 tempest-VolumesTestJSON-1834033160 None] Lock "cinder-quobyte-cb3e5f02-faeb-47ae-88d6-8d128a8e7330" released by "delete_volume" :: held 1.158s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ccaed553-5908-486c-ab19-e917cfc388fc {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:30 devstack sudo[86251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ccaed553-5908-486c-ab19-e917cfc388fc Apr 16 19:43:30 devstack sudo[86251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:30 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-d5d2e442-79e4-4bc5-8b64-95943007a3e2 tempest-VolumesTestJSON-1834033160 None] Created reservations ['2b4e6464-f4d4-4403-85f2-5e3a112fbcb8', '106d9fe7-9553-4367-9841-e1bd57d5316c', '61138142-f7a6-472e-b806-bf5199011bd9', '4dea6db6-d2cc-458f-8065-1bbfb19e2680'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:43:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d5d2e442-79e4-4bc5-8b64-95943007a3e2 tempest-VolumesTestJSON-1834033160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d5d2e442-79e4-4bc5-8b64-95943007a3e2 tempest-VolumesTestJSON-1834033160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d5d2e442-79e4-4bc5-8b64-95943007a3e2 tempest-VolumesTestJSON-1834033160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d5d2e442-79e4-4bc5-8b64-95943007a3e2 tempest-VolumesTestJSON-1834033160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d5d2e442-79e4-4bc5-8b64-95943007a3e2 tempest-VolumesTestJSON-1834033160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d5d2e442-79e4-4bc5-8b64-95943007a3e2 tempest-VolumesTestJSON-1834033160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:30 devstack sudo[86253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:43:30 devstack sudo[86253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ffd3af13-7dab-4ba7-8395-f28e6b962b3d tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:30 devstack sudo[86251]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ccaed553-5908-486c-ab19-e917cfc388fc" returned: 0 in 0.629s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:43:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ffd3af13-7dab-4ba7-8395-f28e6b962b3d tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.446s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b25454-7ea3-48fa-9166-ae9bd8a82f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccaed553-5908-486c-ab19-e917cfc388fc', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e5a6eb-12ca-465c-b8d9-48fe2570b6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-ffd3af13-7dab-4ba7-8395-f28e6b962b3d tempest-CreateVolumesFromSnapshotTest-881659188 None] Creating offline snapshot 48011912-0985-4bb9-adc8-17052fa6d5de of volume 342fc080-ac73-4565-9087-1834af73b0ac {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:43:30 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a20f719-33ac-413a-a36c-73f694d827a8]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:43:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ffd3af13-7dab-4ba7-8395-f28e6b962b3d tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:30 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Volume volume-ccaed553-5908-486c-ab19-e917cfc388fc (ccaed553-5908-486c-ab19-e917cfc388fc): created successfully Apr 16 19:43:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e5a6eb-12ca-465c-b8d9-48fe2570b6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Flow 'volume_create_manager' (af52ece1-741d-4fd5-98cd-ab08de5885f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:30 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-e477c03f-8395-4b19-b294-06b4e2cfceb4 tempest-VolumeQuotasAdminTestJSON-1921342710 None] Created volume successfully. Apr 16 19:43:30 devstack sudo[86253]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d5d2e442-79e4-4bc5-8b64-95943007a3e2 tempest-VolumesTestJSON-1834033160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.633s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:30 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-d5d2e442-79e4-4bc5-8b64-95943007a3e2 tempest-VolumesTestJSON-1834033160 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:43:30 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-d5d2e442-79e4-4bc5-8b64-95943007a3e2 tempest-VolumesTestJSON-1834033160 None] Deleted volume successfully. Apr 16 19:43:30 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d5d2e442-79e4-4bc5-8b64-95943007a3e2 tempest-VolumesTestJSON-1834033160 None] Lock "cinder-cb3e5f02-faeb-47ae-88d6-8d128a8e7330-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:30 devstack sudo[86257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac Apr 16 19:43:30 devstack sudo[86257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:31 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bce03c3c-9e07-4240-8c7a-ed49a4764360 tempest-VolumesTestJSON-1834033160 None] Acquiring lock "cinder-9e67b54c-2206-4e9a-bce1-0631a6dbec7e-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:31 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bce03c3c-9e07-4240-8c7a-ed49a4764360 tempest-VolumesTestJSON-1834033160 None] Lock "cinder-9e67b54c-2206-4e9a-bce1-0631a6dbec7e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:31 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bce03c3c-9e07-4240-8c7a-ed49a4764360 tempest-VolumesTestJSON-1834033160 None] Acquiring lock "cinder-quobyte-9e67b54c-2206-4e9a-bce1-0631a6dbec7e" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:31 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bce03c3c-9e07-4240-8c7a-ed49a4764360 tempest-VolumesTestJSON-1834033160 None] Lock "cinder-quobyte-9e67b54c-2206-4e9a-bce1-0631a6dbec7e" acquired by "delete_volume" :: waited 0.014s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:31 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4a559f-c16f-4140-a50f-820f579ebf11]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:43:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bce03c3c-9e07-4240-8c7a-ed49a4764360 tempest-VolumesTestJSON-1834033160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-9e67b54c-2206-4e9a-bce1-0631a6dbec7e {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:31 devstack sudo[86259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-9e67b54c-2206-4e9a-bce1-0631a6dbec7e Apr 16 19:43:31 devstack sudo[86259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:31 devstack sudo[86257]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ffd3af13-7dab-4ba7-8395-f28e6b962b3d tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac" returned: 0 in 0.580s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ffd3af13-7dab-4ba7-8395-f28e6b962b3d tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac.48011912-0985-4bb9-adc8-17052fa6d5de 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:31 devstack sudo[86264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac.48011912-0985-4bb9-adc8-17052fa6d5de 1G Apr 16 19:43:31 devstack sudo[86264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:31 devstack sudo[86259]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:31 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-b5059967-733a-4bb5-95eb-b2ba31940d72 tempest-VolumeQuotasAdminTestJSON-813597956 None] Transfer volume completed successfully. Apr 16 19:43:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bce03c3c-9e07-4240-8c7a-ed49a4764360 tempest-VolumesTestJSON-1834033160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-9e67b54c-2206-4e9a-bce1-0631a6dbec7e" returned: 0 in 0.733s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bce03c3c-9e07-4240-8c7a-ed49a4764360 tempest-VolumesTestJSON-1834033160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-9e67b54c-2206-4e9a-bce1-0631a6dbec7e {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:32 devstack sudo[86272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-9e67b54c-2206-4e9a-bce1-0631a6dbec7e Apr 16 19:43:32 devstack sudo[86272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:32 devstack sudo[86264]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ffd3af13-7dab-4ba7-8395-f28e6b962b3d tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac.48011912-0985-4bb9-adc8-17052fa6d5de 1G" returned: 0 in 0.636s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ffd3af13-7dab-4ba7-8395-f28e6b962b3d tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-342fc080-ac73-4565-9087-1834af73b0ac -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac.48011912-0985-4bb9-adc8-17052fa6d5de {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:32 devstack sudo[86274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-342fc080-ac73-4565-9087-1834af73b0ac -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac.48011912-0985-4bb9-adc8-17052fa6d5de Apr 16 19:43:32 devstack sudo[86274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:32 devstack sudo[86272]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bce03c3c-9e07-4240-8c7a-ed49a4764360 tempest-VolumesTestJSON-1834033160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-9e67b54c-2206-4e9a-bce1-0631a6dbec7e" returned: 0 in 0.507s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:32 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bce03c3c-9e07-4240-8c7a-ed49a4764360 tempest-VolumesTestJSON-1834033160 None] Lock "cinder-quobyte-9e67b54c-2206-4e9a-bce1-0631a6dbec7e" released by "delete_volume" :: held 1.261s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:32 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-bce03c3c-9e07-4240-8c7a-ed49a4764360 tempest-VolumesTestJSON-1834033160 None] Created reservations ['d02ff1af-6fe4-467c-9644-e1c95626cfa8', '14635b00-1f79-4d5c-a954-abf846283885', 'e2f699a3-b3e6-4768-8994-e7a6ac8aa7b2', 'a0c6fc27-e1c8-44d1-a120-6ce3e2bb9687'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:43:32 devstack sudo[86274]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ffd3af13-7dab-4ba7-8395-f28e6b962b3d tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-342fc080-ac73-4565-9087-1834af73b0ac -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac.48011912-0985-4bb9-adc8-17052fa6d5de" returned: 0 in 0.477s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:32 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-ffd3af13-7dab-4ba7-8395-f28e6b962b3d tempest-CreateVolumesFromSnapshotTest-881659188 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac.48011912-0985-4bb9-adc8-17052fa6d5de is being set with open permissions: ugo+rw Apr 16 19:43:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ffd3af13-7dab-4ba7-8395-f28e6b962b3d tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac.48011912-0985-4bb9-adc8-17052fa6d5de {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:32 devstack sudo[86284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac.48011912-0985-4bb9-adc8-17052fa6d5de Apr 16 19:43:32 devstack sudo[86284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bce03c3c-9e07-4240-8c7a-ed49a4764360 tempest-VolumesTestJSON-1834033160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bce03c3c-9e07-4240-8c7a-ed49a4764360 tempest-VolumesTestJSON-1834033160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:32 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bce03c3c-9e07-4240-8c7a-ed49a4764360 tempest-VolumesTestJSON-1834033160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:32 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bce03c3c-9e07-4240-8c7a-ed49a4764360 tempest-VolumesTestJSON-1834033160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bce03c3c-9e07-4240-8c7a-ed49a4764360 tempest-VolumesTestJSON-1834033160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bce03c3c-9e07-4240-8c7a-ed49a4764360 tempest-VolumesTestJSON-1834033160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:32 devstack sudo[86286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:43:32 devstack sudo[86286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:32 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-376ab9e2-4847-4f24-bd4c-bb4a2c2a0e11 tempest-VolumeQuotasAdminTestJSON-1649156195 None] Acquiring lock "cinder-ccaed553-5908-486c-ab19-e917cfc388fc-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:32 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-376ab9e2-4847-4f24-bd4c-bb4a2c2a0e11 tempest-VolumeQuotasAdminTestJSON-1649156195 None] Lock "cinder-ccaed553-5908-486c-ab19-e917cfc388fc-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:32 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-376ab9e2-4847-4f24-bd4c-bb4a2c2a0e11 tempest-VolumeQuotasAdminTestJSON-1649156195 None] Acquiring lock "cinder-quobyte-ccaed553-5908-486c-ab19-e917cfc388fc" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:32 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-376ab9e2-4847-4f24-bd4c-bb4a2c2a0e11 tempest-VolumeQuotasAdminTestJSON-1649156195 None] Lock "cinder-quobyte-ccaed553-5908-486c-ab19-e917cfc388fc" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:32 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a0ef6c-faaa-456f-844e-2e656942e375]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:43:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-376ab9e2-4847-4f24-bd4c-bb4a2c2a0e11 tempest-VolumeQuotasAdminTestJSON-1649156195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ccaed553-5908-486c-ab19-e917cfc388fc {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:32 devstack sudo[86289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ccaed553-5908-486c-ab19-e917cfc388fc Apr 16 19:43:32 devstack sudo[86289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:33 devstack sudo[86284]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ffd3af13-7dab-4ba7-8395-f28e6b962b3d tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac.48011912-0985-4bb9-adc8-17052fa6d5de" returned: 0 in 0.438s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ffd3af13-7dab-4ba7-8395-f28e6b962b3d tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:33 devstack sudo[86292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac.info Apr 16 19:43:33 devstack sudo[86292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:33 devstack sudo[86286]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bce03c3c-9e07-4240-8c7a-ed49a4764360 tempest-VolumesTestJSON-1834033160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.512s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:33 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-bce03c3c-9e07-4240-8c7a-ed49a4764360 tempest-VolumesTestJSON-1834033160 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:43:33 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-bce03c3c-9e07-4240-8c7a-ed49a4764360 tempest-VolumesTestJSON-1834033160 None] Deleted volume successfully. Apr 16 19:43:33 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bce03c3c-9e07-4240-8c7a-ed49a4764360 tempest-VolumesTestJSON-1834033160 None] Lock "cinder-9e67b54c-2206-4e9a-bce1-0631a6dbec7e-delete_volume" released by "delete_volume" :: held 1.974s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:33 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3f8b080c-5fd1-41e9-bca1-e7fbee91b43f tempest-VolumesTestJSON-1834033160 None] Acquiring lock "cinder-6fc4f7c7-9a56-409b-b059-16ab447611f0-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:33 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3f8b080c-5fd1-41e9-bca1-e7fbee91b43f tempest-VolumesTestJSON-1834033160 None] Lock "cinder-6fc4f7c7-9a56-409b-b059-16ab447611f0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:33 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3f8b080c-5fd1-41e9-bca1-e7fbee91b43f tempest-VolumesTestJSON-1834033160 None] Acquiring lock "cinder-quobyte-6fc4f7c7-9a56-409b-b059-16ab447611f0" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:33 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3f8b080c-5fd1-41e9-bca1-e7fbee91b43f tempest-VolumesTestJSON-1834033160 None] Lock "cinder-quobyte-6fc4f7c7-9a56-409b-b059-16ab447611f0" acquired by "delete_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:33 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[72da5acf-3f0d-466c-aa36-69553d3a8bcd]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:43:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3f8b080c-5fd1-41e9-bca1-e7fbee91b43f tempest-VolumesTestJSON-1834033160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6fc4f7c7-9a56-409b-b059-16ab447611f0 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:33 devstack sudo[86289]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-376ab9e2-4847-4f24-bd4c-bb4a2c2a0e11 tempest-VolumeQuotasAdminTestJSON-1649156195 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ccaed553-5908-486c-ab19-e917cfc388fc" returned: 0 in 0.585s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-376ab9e2-4847-4f24-bd4c-bb4a2c2a0e11 tempest-VolumeQuotasAdminTestJSON-1649156195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ccaed553-5908-486c-ab19-e917cfc388fc {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:33 devstack sudo[86301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ccaed553-5908-486c-ab19-e917cfc388fc Apr 16 19:43:33 devstack sudo[86301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:33 devstack sudo[86300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6fc4f7c7-9a56-409b-b059-16ab447611f0 Apr 16 19:43:33 devstack sudo[86300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:33 devstack sudo[86292]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ffd3af13-7dab-4ba7-8395-f28e6b962b3d tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac.info" returned: 0 in 0.516s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:33 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-ffd3af13-7dab-4ba7-8395-f28e6b962b3d tempest-CreateVolumesFromSnapshotTest-881659188 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac.info is being set with open permissions: ugo+rw Apr 16 19:43:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ffd3af13-7dab-4ba7-8395-f28e6b962b3d tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:33 devstack sudo[86304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac.info Apr 16 19:43:33 devstack sudo[86304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:33 devstack sudo[86301]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-376ab9e2-4847-4f24-bd4c-bb4a2c2a0e11 tempest-VolumeQuotasAdminTestJSON-1649156195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ccaed553-5908-486c-ab19-e917cfc388fc" returned: 0 in 0.496s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-376ab9e2-4847-4f24-bd4c-bb4a2c2a0e11 tempest-VolumeQuotasAdminTestJSON-1649156195 None] Lock "cinder-quobyte-ccaed553-5908-486c-ab19-e917cfc388fc" released by "delete_volume" :: held 1.103s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:34 devstack sudo[86300]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3f8b080c-5fd1-41e9-bca1-e7fbee91b43f tempest-VolumesTestJSON-1834033160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6fc4f7c7-9a56-409b-b059-16ab447611f0" returned: 0 in 0.551s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3f8b080c-5fd1-41e9-bca1-e7fbee91b43f tempest-VolumesTestJSON-1834033160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6fc4f7c7-9a56-409b-b059-16ab447611f0 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:34 devstack sudo[86304]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ffd3af13-7dab-4ba7-8395-f28e6b962b3d tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac.info" returned: 0 in 0.478s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:34 devstack sudo[86311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6fc4f7c7-9a56-409b-b059-16ab447611f0 Apr 16 19:43:34 devstack sudo[86311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ffd3af13-7dab-4ba7-8395-f28e6b962b3d tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.214s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-376ab9e2-4847-4f24-bd4c-bb4a2c2a0e11 tempest-VolumeQuotasAdminTestJSON-1649156195 None] Created reservations ['3b4ca4bb-54d6-45d6-8b62-2c05e669b148', 'ea3b1ac4-79e8-4add-90ff-32e88f0c9ed4', '1db56cf4-aad4-4102-bfcd-1c84fb075402', '51c6e192-2c98-4472-a37b-5743ab92ccdf'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:43:34 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-ffd3af13-7dab-4ba7-8395-f28e6b962b3d tempest-CreateVolumesFromSnapshotTest-881659188 None] Create snapshot completed successfully Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-376ab9e2-4847-4f24-bd4c-bb4a2c2a0e11 tempest-VolumeQuotasAdminTestJSON-1649156195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-376ab9e2-4847-4f24-bd4c-bb4a2c2a0e11 tempest-VolumeQuotasAdminTestJSON-1649156195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-376ab9e2-4847-4f24-bd4c-bb4a2c2a0e11 tempest-VolumeQuotasAdminTestJSON-1649156195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-376ab9e2-4847-4f24-bd4c-bb4a2c2a0e11 tempest-VolumeQuotasAdminTestJSON-1649156195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-376ab9e2-4847-4f24-bd4c-bb4a2c2a0e11 tempest-VolumeQuotasAdminTestJSON-1649156195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-376ab9e2-4847-4f24-bd4c-bb4a2c2a0e11 tempest-VolumeQuotasAdminTestJSON-1649156195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:34 devstack sudo[86313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:43:34 devstack sudo[86313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:34 devstack sudo[86311]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3f8b080c-5fd1-41e9-bca1-e7fbee91b43f tempest-VolumesTestJSON-1834033160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6fc4f7c7-9a56-409b-b059-16ab447611f0" returned: 0 in 0.460s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3f8b080c-5fd1-41e9-bca1-e7fbee91b43f tempest-VolumesTestJSON-1834033160 None] Lock "cinder-quobyte-6fc4f7c7-9a56-409b-b059-16ab447611f0" released by "delete_volume" :: held 1.046s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-3f8b080c-5fd1-41e9-bca1-e7fbee91b43f tempest-VolumesTestJSON-1834033160 None] Created reservations ['ba7aaf59-0e15-4db7-a55d-817d26b1f409', '2d1ceccb-9917-46e9-93a9-f41e15516328', '4fdae94e-87cf-4eaa-bf56-6809aa09b83a', 'd28b9ac9-4e1d-403d-8cd7-995f3644cf88'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:43:34 devstack sudo[86313]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-376ab9e2-4847-4f24-bd4c-bb4a2c2a0e11 tempest-VolumeQuotasAdminTestJSON-1649156195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.476s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-376ab9e2-4847-4f24-bd4c-bb4a2c2a0e11 tempest-VolumeQuotasAdminTestJSON-1649156195 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:43:34 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-376ab9e2-4847-4f24-bd4c-bb4a2c2a0e11 tempest-VolumeQuotasAdminTestJSON-1649156195 None] Deleted volume successfully. Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3f8b080c-5fd1-41e9-bca1-e7fbee91b43f tempest-VolumesTestJSON-1834033160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3f8b080c-5fd1-41e9-bca1-e7fbee91b43f tempest-VolumesTestJSON-1834033160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3f8b080c-5fd1-41e9-bca1-e7fbee91b43f tempest-VolumesTestJSON-1834033160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3f8b080c-5fd1-41e9-bca1-e7fbee91b43f tempest-VolumesTestJSON-1834033160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3f8b080c-5fd1-41e9-bca1-e7fbee91b43f tempest-VolumesTestJSON-1834033160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3f8b080c-5fd1-41e9-bca1-e7fbee91b43f tempest-VolumesTestJSON-1834033160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-376ab9e2-4847-4f24-bd4c-bb4a2c2a0e11 tempest-VolumeQuotasAdminTestJSON-1649156195 None] Lock "cinder-ccaed553-5908-486c-ab19-e917cfc388fc-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:34 devstack sudo[86317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:43:34 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Flow 'volume_create_manager' (cc706def-6040-481d-8150-f66123061764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09751888-0e84-4043-96d0-e494464afa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09751888-0e84-4043-96d0-e494464afa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1334603130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3218cd85-da47-4063-9a90-4ddb7f1a19d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbfc00a50dc74f58aff48cc64736d5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:35Z,use_quota=True,user_id='6f84df46a21345ba9268beb62cc4ac92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a2fa1a-190c-4584-94c4-e546162344cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a2fa1a-190c-4584-94c4-e546162344cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b311bb-f24b-44cd-978b-624949de8e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b311bb-f24b-44cd-978b-624949de8e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3218cd85-da47-4063-9a90-4ddb7f1a19d7', 'volume_name': 'volume-3218cd85-da47-4063-9a90-4ddb7f1a19d7', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e46285-98e9-42e3-b966-1237e20ce129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e46285-98e9-42e3-b966-1237e20ce129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667b3ad2-f297-42af-a0a0-8f6e804b53b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:34 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Volume 3218cd85-da47-4063-9a90-4ddb7f1a19d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3218cd85-da47-4063-9a90-4ddb7f1a19d7', 'volume_size': 1} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1334603130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3218cd85-da47-4063-9a90-4ddb7f1a19d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbfc00a50dc74f58aff48cc64736d5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:35Z,use_quota=True,user_id='6f84df46a21345ba9268beb62cc4ac92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Creating volume 3218cd85-da47-4063-9a90-4ddb7f1a19d7 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:43:34 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:43:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3218cd85-da47-4063-9a90-4ddb7f1a19d7 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:34 devstack sudo[86319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3218cd85-da47-4063-9a90-4ddb7f1a19d7 1073741824 Apr 16 19:43:34 devstack sudo[86319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:35 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3f8b080c-5fd1-41e9-bca1-e7fbee91b43f tempest-VolumesTestJSON-1834033160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.505s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-3f8b080c-5fd1-41e9-bca1-e7fbee91b43f tempest-VolumesTestJSON-1834033160 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:43:35 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-3f8b080c-5fd1-41e9-bca1-e7fbee91b43f tempest-VolumesTestJSON-1834033160 None] Deleted volume successfully. Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Flow 'volume_create_manager' (3b21f090-7340-48a2-93b2-a9e80d217c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c010443-24c4-4eed-a6d7-38dfd75531c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c010443-24c4-4eed-a6d7-38dfd75531c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-551647486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b58bf54c-f5a2-4671-b9ba-9d0ebb594694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbfc00a50dc74f58aff48cc64736d5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:35Z,use_quota=True,user_id='6f84df46a21345ba9268beb62cc4ac92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4416a6-49fa-47f5-944e-f2057a13ea1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4416a6-49fa-47f5-944e-f2057a13ea1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3670486b-15cf-41ee-9b8c-20c8aa5930f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3670486b-15cf-41ee-9b8c-20c8aa5930f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b58bf54c-f5a2-4671-b9ba-9d0ebb594694', 'volume_name': 'volume-b58bf54c-f5a2-4671-b9ba-9d0ebb594694', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (457510c8-6494-45f8-a53d-3435164521f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (457510c8-6494-45f8-a53d-3435164521f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa01dfa4-3651-4c86-9a8d-891eeb63355b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:35 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Volume b58bf54c-f5a2-4671-b9ba-9d0ebb594694: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b58bf54c-f5a2-4671-b9ba-9d0ebb594694', 'volume_size': 1} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3f8b080c-5fd1-41e9-bca1-e7fbee91b43f tempest-VolumesTestJSON-1834033160 None] Lock "cinder-6fc4f7c7-9a56-409b-b059-16ab447611f0-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Flow 'volume_create_manager' (cf46de4d-7857-4bc7-af00-6910802e465a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b826c83-b723-4ffc-834c-0e30c4da419b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b826c83-b723-4ffc-834c-0e30c4da419b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-971019627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95d7c636-e4e9-43bc-838b-fe17bed3b660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbfc00a50dc74f58aff48cc64736d5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:35Z,use_quota=True,user_id='6f84df46a21345ba9268beb62cc4ac92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb25f33-8b1b-4d23-ae4c-3100cb236a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb25f33-8b1b-4d23-ae4c-3100cb236a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5212a561-aefe-4490-ba58-8e7cfaec1fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5212a561-aefe-4490-ba58-8e7cfaec1fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95d7c636-e4e9-43bc-838b-fe17bed3b660', 'volume_name': 'volume-95d7c636-e4e9-43bc-838b-fe17bed3b660', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12d7c87-35b5-430c-a9f4-4410a6bfdea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12d7c87-35b5-430c-a9f4-4410a6bfdea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13bd1675-2fcb-4a1d-96a8-d5426948edc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:35 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Volume 95d7c636-e4e9-43bc-838b-fe17bed3b660: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95d7c636-e4e9-43bc-838b-fe17bed3b660', 'volume_size': 1} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:35 devstack sudo[86319]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3218cd85-da47-4063-9a90-4ddb7f1a19d7 1073741824" returned: 0 in 0.687s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3218cd85-da47-4063-9a90-4ddb7f1a19d7 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:43:35 devstack sudo[86325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3218cd85-da47-4063-9a90-4ddb7f1a19d7 Apr 16 19:43:35 devstack sudo[86325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Flow 'volume_create_manager' (2c56b514-043a-4ea6-bd42-6287467d88bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d795c760-a221-4f96-b6d9-669f3fb89b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d795c760-a221-4f96-b6d9-669f3fb89b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-296497184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f15de01-6a61-4546-b951-b3efea6660e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbfc00a50dc74f58aff48cc64736d5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:36Z,use_quota=True,user_id='6f84df46a21345ba9268beb62cc4ac92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8ca361-a143-472c-af5a-4e558ea51b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8ca361-a143-472c-af5a-4e558ea51b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da7f95dc-c44c-4bac-ad32-a722e18351d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da7f95dc-c44c-4bac-ad32-a722e18351d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f15de01-6a61-4546-b951-b3efea6660e1', 'volume_name': 'volume-4f15de01-6a61-4546-b951-b3efea6660e1', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ab32b8-5f1f-4f5b-ba17-5e456b24b104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ab32b8-5f1f-4f5b-ba17-5e456b24b104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e89f67b-36a4-4048-a18a-763614ba1419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:35 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Volume 4f15de01-6a61-4546-b951-b3efea6660e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f15de01-6a61-4546-b951-b3efea6660e1', 'volume_size': 1} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Flow 'volume_create_manager' (b348aa3a-3f0c-4c49-b5e7-b4e41a721b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e4b9c5-4279-420b-84d0-8d01c1fb0110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e4b9c5-4279-420b-84d0-8d01c1fb0110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-786035361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c40db1b1-b006-4b01-bc25-d9df3f3e8099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbfc00a50dc74f58aff48cc64736d5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:36Z,use_quota=True,user_id='6f84df46a21345ba9268beb62cc4ac92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6169e2ff-31de-4ab0-aee0-c2e9795c0ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6169e2ff-31de-4ab0-aee0-c2e9795c0ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea9704d-d776-4c73-9881-83d11dd96f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea9704d-d776-4c73-9881-83d11dd96f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c40db1b1-b006-4b01-bc25-d9df3f3e8099', 'volume_name': 'volume-c40db1b1-b006-4b01-bc25-d9df3f3e8099', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4fa7280-cb99-4919-82af-211e6e800db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4fa7280-cb99-4919-82af-211e6e800db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a0104eb-b3d4-4bf3-b62f-02fe6c0dda1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:36 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Volume c40db1b1-b006-4b01-bc25-d9df3f3e8099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c40db1b1-b006-4b01-bc25-d9df3f3e8099', 'volume_size': 1} Apr 16 19:43:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:36 devstack sudo[86325]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3218cd85-da47-4063-9a90-4ddb7f1a19d7" returned: 0 in 0.616s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:36 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:43:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.968s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:36 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-551647486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b58bf54c-f5a2-4671-b9ba-9d0ebb594694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbfc00a50dc74f58aff48cc64736d5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:35Z,use_quota=True,user_id='6f84df46a21345ba9268beb62cc4ac92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:43:36 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Creating volume b58bf54c-f5a2-4671-b9ba-9d0ebb594694 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:43:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:36 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:36 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:36 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:43:36 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:43:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b58bf54c-f5a2-4671-b9ba-9d0ebb594694 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667b3ad2-f297-42af-a0a0-8f6e804b53b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3218cd85-da47-4063-9a90-4ddb7f1a19d7', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620e495a-b9e4-4f3e-b77c-32da8eafc664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:36 devstack sudo[86328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b58bf54c-f5a2-4671-b9ba-9d0ebb594694 1073741824 Apr 16 19:43:36 devstack sudo[86328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:36 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Volume volume-3218cd85-da47-4063-9a90-4ddb7f1a19d7 (3218cd85-da47-4063-9a90-4ddb7f1a19d7): created successfully Apr 16 19:43:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620e495a-b9e4-4f3e-b77c-32da8eafc664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Flow 'volume_create_manager' (cc706def-6040-481d-8150-f66123061764) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:36 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-fc44eb75-8d74-4753-9029-e1194efc189c tempest-CreateVolumesFromSnapshotTest-881659188 None] Created volume successfully. Apr 16 19:43:36 devstack sudo[86328]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b58bf54c-f5a2-4671-b9ba-9d0ebb594694 1073741824" returned: 0 in 0.696s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b58bf54c-f5a2-4671-b9ba-9d0ebb594694 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:37 devstack sudo[86333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b58bf54c-f5a2-4671-b9ba-9d0ebb594694 Apr 16 19:43:37 devstack sudo[86333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:37 devstack sudo[86333]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b58bf54c-f5a2-4671-b9ba-9d0ebb594694" returned: 0 in 0.652s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:37 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:43:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.218s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:37 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-971019627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95d7c636-e4e9-43bc-838b-fe17bed3b660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbfc00a50dc74f58aff48cc64736d5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:35Z,use_quota=True,user_id='6f84df46a21345ba9268beb62cc4ac92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:43:37 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Creating volume 95d7c636-e4e9-43bc-838b-fe17bed3b660 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:43:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:37 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:37 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:37 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:43:37 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:43:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-95d7c636-e4e9-43bc-838b-fe17bed3b660 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa01dfa4-3651-4c86-9a8d-891eeb63355b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b58bf54c-f5a2-4671-b9ba-9d0ebb594694', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5072c852-f6df-4dc7-bb25-9067d12da8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:37 devstack sudo[86336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-95d7c636-e4e9-43bc-838b-fe17bed3b660 1073741824 Apr 16 19:43:37 devstack sudo[86336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:37 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Volume volume-b58bf54c-f5a2-4671-b9ba-9d0ebb594694 (b58bf54c-f5a2-4671-b9ba-9d0ebb594694): created successfully Apr 16 19:43:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5072c852-f6df-4dc7-bb25-9067d12da8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Flow 'volume_create_manager' (3b21f090-7340-48a2-93b2-a9e80d217c40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:37 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-d4952732-76b8-4660-a442-cc41b525770c tempest-CreateVolumesFromSnapshotTest-881659188 None] Created volume successfully. Apr 16 19:43:38 devstack sudo[86336]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-95d7c636-e4e9-43bc-838b-fe17bed3b660 1073741824" returned: 0 in 0.915s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-95d7c636-e4e9-43bc-838b-fe17bed3b660 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:38 devstack sudo[86345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-95d7c636-e4e9-43bc-838b-fe17bed3b660 Apr 16 19:43:38 devstack sudo[86345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:39 devstack sudo[86345]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-95d7c636-e4e9-43bc-838b-fe17bed3b660" returned: 0 in 0.612s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:43:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.403s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-296497184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f15de01-6a61-4546-b951-b3efea6660e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbfc00a50dc74f58aff48cc64736d5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:36Z,use_quota=True,user_id='6f84df46a21345ba9268beb62cc4ac92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:43:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Creating volume 4f15de01-6a61-4546-b951-b3efea6660e1 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:43:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:43:39 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:43:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4f15de01-6a61-4546-b951-b3efea6660e1 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:39 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13bd1675-2fcb-4a1d-96a8-d5426948edc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95d7c636-e4e9-43bc-838b-fe17bed3b660', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:39 devstack sudo[86361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4f15de01-6a61-4546-b951-b3efea6660e1 1073741824 Apr 16 19:43:39 devstack sudo[86361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:39 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e5424fb-8582-4459-85ee-e6f390afb290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:39 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Volume volume-95d7c636-e4e9-43bc-838b-fe17bed3b660 (95d7c636-e4e9-43bc-838b-fe17bed3b660): created successfully Apr 16 19:43:39 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e5424fb-8582-4459-85ee-e6f390afb290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:39 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Flow 'volume_create_manager' (cf46de4d-7857-4bc7-af00-6910802e465a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:39 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-245200cf-6e62-4a4d-9d94-4235337b0cf8 tempest-CreateVolumesFromSnapshotTest-881659188 None] Created volume successfully. Apr 16 19:43:39 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-86e90727-6a36-457d-b4ce-3cca02fbb8fd tempest-BackendsCapabilitiesAdminTestsJSON-1570810062 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6951370239258, 'free_capacity_gb': 1775.6951370239258, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82569) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 16 19:43:39 devstack sudo[86361]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4f15de01-6a61-4546-b951-b3efea6660e1 1073741824" returned: 0 in 0.660s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4f15de01-6a61-4546-b951-b3efea6660e1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:39 devstack sudo[86366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4f15de01-6a61-4546-b951-b3efea6660e1 Apr 16 19:43:39 devstack sudo[86366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-37c2a5bb-ed83-48c8-ad4d-b8b02ed64b7b tempest-BackendsCapabilitiesAdminTestsJSON-1570810062 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6951370239258, 'free_capacity_gb': 1775.6951370239258, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82569) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 16 19:43:40 devstack sudo[86366]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4f15de01-6a61-4546-b951-b3efea6660e1" returned: 0 in 0.511s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:43:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.427s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-786035361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c40db1b1-b006-4b01-bc25-d9df3f3e8099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbfc00a50dc74f58aff48cc64736d5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:36Z,use_quota=True,user_id='6f84df46a21345ba9268beb62cc4ac92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:43:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Creating volume c40db1b1-b006-4b01-bc25-d9df3f3e8099 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:43:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:43:40 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:43:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c40db1b1-b006-4b01-bc25-d9df3f3e8099 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e89f67b-36a4-4048-a18a-763614ba1419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f15de01-6a61-4546-b951-b3efea6660e1', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17534b2-d922-461a-a7ab-ba0b79374ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:40 devstack sudo[86369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c40db1b1-b006-4b01-bc25-d9df3f3e8099 1073741824 Apr 16 19:43:40 devstack sudo[86369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:40 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Volume volume-4f15de01-6a61-4546-b951-b3efea6660e1 (4f15de01-6a61-4546-b951-b3efea6660e1): created successfully Apr 16 19:43:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17534b2-d922-461a-a7ab-ba0b79374ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Flow 'volume_create_manager' (2c56b514-043a-4ea6-bd42-6287467d88bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:40 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-3617096b-a423-410a-bbe8-3d15c7bc54e3 tempest-CreateVolumesFromSnapshotTest-881659188 None] Created volume successfully. Apr 16 19:43:41 devstack sudo[86369]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c40db1b1-b006-4b01-bc25-d9df3f3e8099 1073741824" returned: 0 in 0.567s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c40db1b1-b006-4b01-bc25-d9df3f3e8099 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:41 devstack sudo[86374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c40db1b1-b006-4b01-bc25-d9df3f3e8099 Apr 16 19:43:41 devstack sudo[86374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:41 devstack sudo[86374]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c40db1b1-b006-4b01-bc25-d9df3f3e8099" returned: 0 in 0.599s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:41 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:43:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a0104eb-b3d4-4bf3-b62f-02fe6c0dda1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c40db1b1-b006-4b01-bc25-d9df3f3e8099', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa40eab-8cca-448e-a8af-ff40d224d9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:41 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Volume volume-c40db1b1-b006-4b01-bc25-d9df3f3e8099 (c40db1b1-b006-4b01-bc25-d9df3f3e8099): created successfully Apr 16 19:43:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa40eab-8cca-448e-a8af-ff40d224d9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Flow 'volume_create_manager' (b348aa3a-3f0c-4c49-b5e7-b4e41a721b29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:41 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-133e0280-77ec-4982-a147-760c55ee8e87 tempest-CreateVolumesFromSnapshotTest-881659188 None] Created volume successfully. Apr 16 19:43:42 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9dab5511-1b2f-47da-9c84-2bf451d0fdc6 tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "cinder-c40db1b1-b006-4b01-bc25-d9df3f3e8099-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:42 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9dab5511-1b2f-47da-9c84-2bf451d0fdc6 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-c40db1b1-b006-4b01-bc25-d9df3f3e8099-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:42 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9dab5511-1b2f-47da-9c84-2bf451d0fdc6 tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "cinder-quobyte-c40db1b1-b006-4b01-bc25-d9df3f3e8099" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:42 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9dab5511-1b2f-47da-9c84-2bf451d0fdc6 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-quobyte-c40db1b1-b006-4b01-bc25-d9df3f3e8099" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:42 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[491cf9ef-25fb-4d50-ab7b-a55d39298c83]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:43:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9dab5511-1b2f-47da-9c84-2bf451d0fdc6 tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c40db1b1-b006-4b01-bc25-d9df3f3e8099 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:42 devstack sudo[86380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c40db1b1-b006-4b01-bc25-d9df3f3e8099 Apr 16 19:43:42 devstack sudo[86380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:43 devstack sudo[86380]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9dab5511-1b2f-47da-9c84-2bf451d0fdc6 tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c40db1b1-b006-4b01-bc25-d9df3f3e8099" returned: 0 in 0.662s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9dab5511-1b2f-47da-9c84-2bf451d0fdc6 tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c40db1b1-b006-4b01-bc25-d9df3f3e8099 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:43 devstack sudo[86386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c40db1b1-b006-4b01-bc25-d9df3f3e8099 Apr 16 19:43:43 devstack sudo[86386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:44 devstack sudo[86386]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9dab5511-1b2f-47da-9c84-2bf451d0fdc6 tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c40db1b1-b006-4b01-bc25-d9df3f3e8099" returned: 0 in 0.718s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:44 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9dab5511-1b2f-47da-9c84-2bf451d0fdc6 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-quobyte-c40db1b1-b006-4b01-bc25-d9df3f3e8099" released by "delete_volume" :: held 1.414s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:44 devstack cinder-volume[82569]: DEBUG dbcounter [-] [82569] Writing DB stats cinder:SELECT=147,cinder:INSERT=45,cinder:UPDATE=213,cinder:DELETE=15 {{(pid=82569) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:43:44 devstack cinder-volume[82569]: DEBUG dbcounter [-] [82569] Writing DB stats cinder:SELECT=121,cinder:INSERT=44,cinder:UPDATE=160,cinder:DELETE=18 {{(pid=82569) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:43:44 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-9dab5511-1b2f-47da-9c84-2bf451d0fdc6 tempest-CreateVolumesFromSnapshotTest-881659188 None] Created reservations ['036e51ed-59ba-4d7b-b63e-4a8f8523f0ab', '3c89dd6f-37a7-421c-89d4-06fb636a86fd', '1dddb799-0b2f-4887-8cec-4a13626a42b4', '61594380-c291-4ac3-a64a-5cc187018aaf'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:43:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9dab5511-1b2f-47da-9c84-2bf451d0fdc6 tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9dab5511-1b2f-47da-9c84-2bf451d0fdc6 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-9dab5511-1b2f-47da-9c84-2bf451d0fdc6 tempest-CreateVolumesFromSnapshotTest-881659188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-9dab5511-1b2f-47da-9c84-2bf451d0fdc6 tempest-CreateVolumesFromSnapshotTest-881659188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9dab5511-1b2f-47da-9c84-2bf451d0fdc6 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.060s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9dab5511-1b2f-47da-9c84-2bf451d0fdc6 tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:44 devstack sudo[86419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:43:44 devstack sudo[86419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:44 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-200f130d-60b5-4f40-8756-898a1435b440 tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "cinder-4f15de01-6a61-4546-b951-b3efea6660e1-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:44 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-200f130d-60b5-4f40-8756-898a1435b440 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-4f15de01-6a61-4546-b951-b3efea6660e1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:45 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-200f130d-60b5-4f40-8756-898a1435b440 tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "cinder-quobyte-4f15de01-6a61-4546-b951-b3efea6660e1" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:45 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-200f130d-60b5-4f40-8756-898a1435b440 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-quobyte-4f15de01-6a61-4546-b951-b3efea6660e1" acquired by "delete_volume" :: waited 0.015s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:45 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[69237041-e9d6-4d66-93b4-1e8beb94512c]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:43:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-200f130d-60b5-4f40-8756-898a1435b440 tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4f15de01-6a61-4546-b951-b3efea6660e1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:45 devstack sudo[86422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4f15de01-6a61-4546-b951-b3efea6660e1 Apr 16 19:43:45 devstack sudo[86422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:45 devstack sudo[86419]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9dab5511-1b2f-47da-9c84-2bf451d0fdc6 tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 1.188s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:45 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-9dab5511-1b2f-47da-9c84-2bf451d0fdc6 tempest-CreateVolumesFromSnapshotTest-881659188 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:43:45 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-9dab5511-1b2f-47da-9c84-2bf451d0fdc6 tempest-CreateVolumesFromSnapshotTest-881659188 None] Deleted volume successfully. Apr 16 19:43:45 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9dab5511-1b2f-47da-9c84-2bf451d0fdc6 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-c40db1b1-b006-4b01-bc25-d9df3f3e8099-delete_volume" released by "delete_volume" :: held 2.976s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:45 devstack sudo[86422]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-200f130d-60b5-4f40-8756-898a1435b440 tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4f15de01-6a61-4546-b951-b3efea6660e1" returned: 0 in 0.798s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-200f130d-60b5-4f40-8756-898a1435b440 tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4f15de01-6a61-4546-b951-b3efea6660e1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:45 devstack sudo[86428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4f15de01-6a61-4546-b951-b3efea6660e1 Apr 16 19:43:45 devstack sudo[86428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:46 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-5567e64b-5412-41b4-86f9-042b82b1b0fc tempest-GroupSnapshotsV319Test-1496412250 None] Group tempest-GroupSnapshotsV319Test-Group-1601607503: creating Apr 16 19:43:46 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-5567e64b-5412-41b4-86f9-042b82b1b0fc tempest-GroupSnapshotsV319Test-1496412250 None] Group tempest-GroupSnapshotsV319Test-Group-1601607503: created successfully Apr 16 19:43:46 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-5567e64b-5412-41b4-86f9-042b82b1b0fc tempest-GroupSnapshotsV319Test-1496412250 None] Create group completed successfully. Apr 16 19:43:46 devstack sudo[86428]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-200f130d-60b5-4f40-8756-898a1435b440 tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4f15de01-6a61-4546-b951-b3efea6660e1" returned: 0 in 0.776s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:46 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-200f130d-60b5-4f40-8756-898a1435b440 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-quobyte-4f15de01-6a61-4546-b951-b3efea6660e1" released by "delete_volume" :: held 1.620s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:46 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-200f130d-60b5-4f40-8756-898a1435b440 tempest-CreateVolumesFromSnapshotTest-881659188 None] Created reservations ['420fbac3-befb-46c0-9d31-6f0cf8731ba6', '72a56b9f-b063-4199-911d-57de3db1f582', '41803459-bc0a-41be-9d28-74b0ee70003f', '001512e3-0885-430f-90ff-8885a3781102'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:43:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-200f130d-60b5-4f40-8756-898a1435b440 tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-200f130d-60b5-4f40-8756-898a1435b440 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:46 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-200f130d-60b5-4f40-8756-898a1435b440 tempest-CreateVolumesFromSnapshotTest-881659188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:46 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-200f130d-60b5-4f40-8756-898a1435b440 tempest-CreateVolumesFromSnapshotTest-881659188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-200f130d-60b5-4f40-8756-898a1435b440 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-200f130d-60b5-4f40-8756-898a1435b440 tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:46 devstack sudo[86432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:43:46 devstack sudo[86432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3c38a754-b49c-48ef-919b-70f0415a395f tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "cinder-95d7c636-e4e9-43bc-838b-fe17bed3b660-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3c38a754-b49c-48ef-919b-70f0415a395f tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-95d7c636-e4e9-43bc-838b-fe17bed3b660-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3c38a754-b49c-48ef-919b-70f0415a395f tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "cinder-quobyte-95d7c636-e4e9-43bc-838b-fe17bed3b660" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3c38a754-b49c-48ef-919b-70f0415a395f tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-quobyte-95d7c636-e4e9-43bc-838b-fe17bed3b660" acquired by "delete_volume" :: waited 0.013s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[18baa668-3f75-4137-b13b-58f96b0670dc]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3c38a754-b49c-48ef-919b-70f0415a395f tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-95d7c636-e4e9-43bc-838b-fe17bed3b660 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:47 devstack sudo[86439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-95d7c636-e4e9-43bc-838b-fe17bed3b660 Apr 16 19:43:47 devstack sudo[86439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:47 devstack sudo[86432]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-200f130d-60b5-4f40-8756-898a1435b440 tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.784s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-200f130d-60b5-4f40-8756-898a1435b440 tempest-CreateVolumesFromSnapshotTest-881659188 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:43:47 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-200f130d-60b5-4f40-8756-898a1435b440 tempest-CreateVolumesFromSnapshotTest-881659188 None] Deleted volume successfully. Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-200f130d-60b5-4f40-8756-898a1435b440 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-4f15de01-6a61-4546-b951-b3efea6660e1-delete_volume" released by "delete_volume" :: held 2.649s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Flow 'volume_create_manager' (d1faa736-615b-417b-af97-0185a2283516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91370c31-aa2f-4e87-b48a-81c0d489c4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91370c31-aa2f-4e87-b48a-81c0d489c4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-74245094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=40569edd-e7cf-41ea-9d16-6714d67a1fca,host='devstack@QuobyteHD#QuobyteHD',id=77649d1a-a050-4c3f-92cb-c4974191f4f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9189353a3fe42a1985e50e4d1b1fc18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:48Z,use_quota=True,user_id='1561c5f411594df7817eb2eb314235aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fb4ea08-3885-4c1a-a1f2-24d923c26a66),volume_type_id=6fb4ea08-3885-4c1a-a1f2-24d923c26a66)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba0ab78-2226-4ba7-96fb-86c18105f8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba0ab78-2226-4ba7-96fb-86c18105f8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (780fc3fc-782d-4da2-aa98-8b44fc53ed49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (780fc3fc-782d-4da2-aa98-8b44fc53ed49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77649d1a-a050-4c3f-92cb-c4974191f4f6', 'volume_name': 'volume-77649d1a-a050-4c3f-92cb-c4974191f4f6', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (390b3f4c-6f62-4cee-a30e-d472e10c4dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (390b3f4c-6f62-4cee-a30e-d472e10c4dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9f8f74-a6b2-42f6-b53a-a104f8720075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:47 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Volume 77649d1a-a050-4c3f-92cb-c4974191f4f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77649d1a-a050-4c3f-92cb-c4974191f4f6', 'volume_size': 1} Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=40569edd-e7cf-41ea-9d16-6714d67a1fca,created_at=2026-04-16T17:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-74245094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=40569edd-e7cf-41ea-9d16-6714d67a1fca,host='devstack@QuobyteHD#QuobyteHD',id=77649d1a-a050-4c3f-92cb-c4974191f4f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9189353a3fe42a1985e50e4d1b1fc18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:48Z,use_quota=True,user_id='1561c5f411594df7817eb2eb314235aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fb4ea08-3885-4c1a-a1f2-24d923c26a66),volume_type_id=6fb4ea08-3885-4c1a-a1f2-24d923c26a66)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Creating volume 77649d1a-a050-4c3f-92cb-c4974191f4f6 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:43:47 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:43:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:47 devstack sudo[86443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6 1073741824 Apr 16 19:43:47 devstack sudo[86443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:48 devstack sudo[86439]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3c38a754-b49c-48ef-919b-70f0415a395f tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-95d7c636-e4e9-43bc-838b-fe17bed3b660" returned: 0 in 0.743s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3c38a754-b49c-48ef-919b-70f0415a395f tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-95d7c636-e4e9-43bc-838b-fe17bed3b660 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:48 devstack sudo[86448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-95d7c636-e4e9-43bc-838b-fe17bed3b660 Apr 16 19:43:48 devstack sudo[86448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:48 devstack sudo[86443]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6 1073741824" returned: 0 in 0.695s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:48 devstack sudo[86448]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3c38a754-b49c-48ef-919b-70f0415a395f tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-95d7c636-e4e9-43bc-838b-fe17bed3b660" returned: 0 in 0.597s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3c38a754-b49c-48ef-919b-70f0415a395f tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-quobyte-95d7c636-e4e9-43bc-838b-fe17bed3b660" released by "delete_volume" :: held 1.373s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:48 devstack sudo[86454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6 Apr 16 19:43:48 devstack sudo[86454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:48 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-3c38a754-b49c-48ef-919b-70f0415a395f tempest-CreateVolumesFromSnapshotTest-881659188 None] Created reservations ['d9640379-b073-49e9-a12f-1dcb05acd48c', 'a811be5f-028b-42ea-bfe0-119ad383dbf8', '3987726b-d426-41ea-be1b-3489ed22aa22', '2b2c115a-da6f-4cc1-bc01-3f5b2e343f13'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:43:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3c38a754-b49c-48ef-919b-70f0415a395f tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3c38a754-b49c-48ef-919b-70f0415a395f tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3c38a754-b49c-48ef-919b-70f0415a395f tempest-CreateVolumesFromSnapshotTest-881659188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3c38a754-b49c-48ef-919b-70f0415a395f tempest-CreateVolumesFromSnapshotTest-881659188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3c38a754-b49c-48ef-919b-70f0415a395f tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3c38a754-b49c-48ef-919b-70f0415a395f tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:48 devstack sudo[86456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:43:48 devstack sudo[86456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:49 devstack sudo[86454]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6" returned: 0 in 0.624s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:49 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:43:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9f8f74-a6b2-42f6-b53a-a104f8720075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77649d1a-a050-4c3f-92cb-c4974191f4f6', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7fdf17f-17e8-4828-a222-d3b661606ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:49 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Volume volume-77649d1a-a050-4c3f-92cb-c4974191f4f6 (77649d1a-a050-4c3f-92cb-c4974191f4f6): created successfully Apr 16 19:43:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7fdf17f-17e8-4828-a222-d3b661606ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Flow 'volume_create_manager' (d1faa736-615b-417b-af97-0185a2283516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:49 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-784558aa-8822-4440-a838-b15c69524e89 tempest-GroupSnapshotsV319Test-1496412250 None] Created volume successfully. Apr 16 19:43:49 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bd0bfbaf-419b-4898-9b9b-e8d357c15614 tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "cinder-b58bf54c-f5a2-4671-b9ba-9d0ebb594694-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:49 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bd0bfbaf-419b-4898-9b9b-e8d357c15614 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-b58bf54c-f5a2-4671-b9ba-9d0ebb594694-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:49 devstack sudo[86456]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:49 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bd0bfbaf-419b-4898-9b9b-e8d357c15614 tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "cinder-quobyte-b58bf54c-f5a2-4671-b9ba-9d0ebb594694" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3c38a754-b49c-48ef-919b-70f0415a395f tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.754s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:49 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-3c38a754-b49c-48ef-919b-70f0415a395f tempest-CreateVolumesFromSnapshotTest-881659188 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:43:49 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-3c38a754-b49c-48ef-919b-70f0415a395f tempest-CreateVolumesFromSnapshotTest-881659188 None] Deleted volume successfully. Apr 16 19:43:49 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bd0bfbaf-419b-4898-9b9b-e8d357c15614 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-quobyte-b58bf54c-f5a2-4671-b9ba-9d0ebb594694" acquired by "delete_volume" :: waited 0.022s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:49 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3c38a754-b49c-48ef-919b-70f0415a395f tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-95d7c636-e4e9-43bc-838b-fe17bed3b660-delete_volume" released by "delete_volume" :: held 2.333s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:49 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[adca01ff-faa2-4331-adcf-4243d57a4d68]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:43:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bd0bfbaf-419b-4898-9b9b-e8d357c15614 tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b58bf54c-f5a2-4671-b9ba-9d0ebb594694 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:49 devstack sudo[86460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b58bf54c-f5a2-4671-b9ba-9d0ebb594694 Apr 16 19:43:49 devstack sudo[86460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:50 devstack sudo[86460]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bd0bfbaf-419b-4898-9b9b-e8d357c15614 tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b58bf54c-f5a2-4671-b9ba-9d0ebb594694" returned: 0 in 0.609s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bd0bfbaf-419b-4898-9b9b-e8d357c15614 tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b58bf54c-f5a2-4671-b9ba-9d0ebb594694 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:50 devstack sudo[86472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b58bf54c-f5a2-4671-b9ba-9d0ebb594694 Apr 16 19:43:50 devstack sudo[86472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:50 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-bcd89cd1-4455-48e7-93ac-939fa769553b tempest-GroupSnapshotsV319Test-1496412250 None] GroupSnapshot b2ab9aad-d72c-46ab-b65b-6c3066ad8def: creating. Apr 16 19:43:50 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bcd89cd1-4455-48e7-93ac-939fa769553b tempest-GroupSnapshotsV319Test-1496412250 None] Group snapshot b2ab9aad-d72c-46ab-b65b-6c3066ad8def: creating. {{(pid=82569) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 16 19:43:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bcd89cd1-4455-48e7-93ac-939fa769553b tempest-GroupSnapshotsV319Test-1496412250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bcd89cd1-4455-48e7-93ac-939fa769553b tempest-GroupSnapshotsV319Test-1496412250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-bcd89cd1-4455-48e7-93ac-939fa769553b tempest-GroupSnapshotsV319Test-1496412250 None] Creating offline snapshot 4f8604de-7967-4954-96be-af81b9a9d0c7 of volume 77649d1a-a050-4c3f-92cb-c4974191f4f6 {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:43:50 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06fad04-9214-411f-be60-500b0170f3eb]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:43:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcd89cd1-4455-48e7-93ac-939fa769553b tempest-GroupSnapshotsV319Test-1496412250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:50 devstack sudo[86474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6 Apr 16 19:43:50 devstack sudo[86474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:50 devstack sudo[86472]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bd0bfbaf-419b-4898-9b9b-e8d357c15614 tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b58bf54c-f5a2-4671-b9ba-9d0ebb594694" returned: 0 in 0.591s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:50 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bd0bfbaf-419b-4898-9b9b-e8d357c15614 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-quobyte-b58bf54c-f5a2-4671-b9ba-9d0ebb594694" released by "delete_volume" :: held 1.239s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:50 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-bd0bfbaf-419b-4898-9b9b-e8d357c15614 tempest-CreateVolumesFromSnapshotTest-881659188 None] Created reservations ['bb22bf50-3171-409e-9e03-079bc74df66b', '2b6a76d2-02f8-41af-8b84-abcf319a21a2', '357b3367-80a9-4a5d-9f30-8401f625bcc5', 'a83befb3-fc2f-499b-9447-436200181be8'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:43:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bd0bfbaf-419b-4898-9b9b-e8d357c15614 tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bd0bfbaf-419b-4898-9b9b-e8d357c15614 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bd0bfbaf-419b-4898-9b9b-e8d357c15614 tempest-CreateVolumesFromSnapshotTest-881659188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bd0bfbaf-419b-4898-9b9b-e8d357c15614 tempest-CreateVolumesFromSnapshotTest-881659188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bd0bfbaf-419b-4898-9b9b-e8d357c15614 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bd0bfbaf-419b-4898-9b9b-e8d357c15614 tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:50 devstack sudo[86480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:43:50 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:50 devstack sudo[86474]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcd89cd1-4455-48e7-93ac-939fa769553b tempest-GroupSnapshotsV319Test-1496412250 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6" returned: 0 in 0.678s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcd89cd1-4455-48e7-93ac-939fa769553b tempest-GroupSnapshotsV319Test-1496412250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6.4f8604de-7967-4954-96be-af81b9a9d0c7 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:51 devstack sudo[86482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6.4f8604de-7967-4954-96be-af81b9a9d0c7 1G Apr 16 19:43:51 devstack sudo[86482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:51 devstack sudo[86482]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcd89cd1-4455-48e7-93ac-939fa769553b tempest-GroupSnapshotsV319Test-1496412250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6.4f8604de-7967-4954-96be-af81b9a9d0c7 1G" returned: 0 in 0.626s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcd89cd1-4455-48e7-93ac-939fa769553b tempest-GroupSnapshotsV319Test-1496412250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77649d1a-a050-4c3f-92cb-c4974191f4f6 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6.4f8604de-7967-4954-96be-af81b9a9d0c7 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:51 devstack sudo[86494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77649d1a-a050-4c3f-92cb-c4974191f4f6 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6.4f8604de-7967-4954-96be-af81b9a9d0c7 Apr 16 19:43:51 devstack sudo[86494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:51 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bd0bfbaf-419b-4898-9b9b-e8d357c15614 tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.791s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:51 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-bd0bfbaf-419b-4898-9b9b-e8d357c15614 tempest-CreateVolumesFromSnapshotTest-881659188 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:43:51 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-bd0bfbaf-419b-4898-9b9b-e8d357c15614 tempest-CreateVolumesFromSnapshotTest-881659188 None] Deleted volume successfully. Apr 16 19:43:51 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e3897120-79a9-4d58-a56a-7c8e7fb2dcf9 tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "cinder-3218cd85-da47-4063-9a90-4ddb7f1a19d7-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:51 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e3897120-79a9-4d58-a56a-7c8e7fb2dcf9 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-3218cd85-da47-4063-9a90-4ddb7f1a19d7-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:51 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bd0bfbaf-419b-4898-9b9b-e8d357c15614 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-b58bf54c-f5a2-4671-b9ba-9d0ebb594694-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:52 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e3897120-79a9-4d58-a56a-7c8e7fb2dcf9 tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "cinder-quobyte-3218cd85-da47-4063-9a90-4ddb7f1a19d7" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:52 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e3897120-79a9-4d58-a56a-7c8e7fb2dcf9 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-quobyte-3218cd85-da47-4063-9a90-4ddb7f1a19d7" acquired by "delete_volume" :: waited 0.019s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:52 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[128a2f29-0113-4340-8968-60e58f16d597]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:43:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e3897120-79a9-4d58-a56a-7c8e7fb2dcf9 tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3218cd85-da47-4063-9a90-4ddb7f1a19d7 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:52 devstack sudo[86496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3218cd85-da47-4063-9a90-4ddb7f1a19d7 Apr 16 19:43:52 devstack sudo[86496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:52 devstack sudo[86494]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcd89cd1-4455-48e7-93ac-939fa769553b tempest-GroupSnapshotsV319Test-1496412250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77649d1a-a050-4c3f-92cb-c4974191f4f6 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6.4f8604de-7967-4954-96be-af81b9a9d0c7" returned: 0 in 1.019s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:52 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-bcd89cd1-4455-48e7-93ac-939fa769553b tempest-GroupSnapshotsV319Test-1496412250 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6.4f8604de-7967-4954-96be-af81b9a9d0c7 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 19:43:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcd89cd1-4455-48e7-93ac-939fa769553b tempest-GroupSnapshotsV319Test-1496412250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6.4f8604de-7967-4954-96be-af81b9a9d0c7 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:52 devstack sudo[86501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6.4f8604de-7967-4954-96be-af81b9a9d0c7 Apr 16 19:43:52 devstack sudo[86501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:53 devstack sudo[86496]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e3897120-79a9-4d58-a56a-7c8e7fb2dcf9 tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3218cd85-da47-4063-9a90-4ddb7f1a19d7" returned: 0 in 1.169s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e3897120-79a9-4d58-a56a-7c8e7fb2dcf9 tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3218cd85-da47-4063-9a90-4ddb7f1a19d7 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:53 devstack sudo[86506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3218cd85-da47-4063-9a90-4ddb7f1a19d7 Apr 16 19:43:53 devstack sudo[86506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:53 devstack sudo[86501]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcd89cd1-4455-48e7-93ac-939fa769553b tempest-GroupSnapshotsV319Test-1496412250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6.4f8604de-7967-4954-96be-af81b9a9d0c7" returned: 0 in 0.815s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcd89cd1-4455-48e7-93ac-939fa769553b tempest-GroupSnapshotsV319Test-1496412250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:53 devstack sudo[86510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6.info Apr 16 19:43:53 devstack sudo[86510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:53 devstack sudo[86506]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e3897120-79a9-4d58-a56a-7c8e7fb2dcf9 tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3218cd85-da47-4063-9a90-4ddb7f1a19d7" returned: 0 in 0.637s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:53 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e3897120-79a9-4d58-a56a-7c8e7fb2dcf9 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-quobyte-3218cd85-da47-4063-9a90-4ddb7f1a19d7" released by "delete_volume" :: held 1.860s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:53 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-e3897120-79a9-4d58-a56a-7c8e7fb2dcf9 tempest-CreateVolumesFromSnapshotTest-881659188 None] Created reservations ['530de6a9-8788-49da-9bb0-cc72e4f25632', 'a64e978e-c745-42f0-bfbe-18f10c97a794', 'b0f63392-7622-4dbf-aa8d-8aa51d0cbdfb', 'e4c923ce-d4d8-4c9e-a0d3-21c728495542'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:43:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e3897120-79a9-4d58-a56a-7c8e7fb2dcf9 tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e3897120-79a9-4d58-a56a-7c8e7fb2dcf9 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:54 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e3897120-79a9-4d58-a56a-7c8e7fb2dcf9 tempest-CreateVolumesFromSnapshotTest-881659188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:54 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e3897120-79a9-4d58-a56a-7c8e7fb2dcf9 tempest-CreateVolumesFromSnapshotTest-881659188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e3897120-79a9-4d58-a56a-7c8e7fb2dcf9 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e3897120-79a9-4d58-a56a-7c8e7fb2dcf9 tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:54 devstack sudo[86520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:43:54 devstack sudo[86520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:54 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-70936ba7-3c9b-4d58-aacd-ca16eab2716f tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "cinder-48011912-0985-4bb9-adc8-17052fa6d5de-delete_snapshot" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:54 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-70936ba7-3c9b-4d58-aacd-ca16eab2716f tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-48011912-0985-4bb9-adc8-17052fa6d5de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:54 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-70936ba7-3c9b-4d58-aacd-ca16eab2716f tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "cinder-quobyte-342fc080-ac73-4565-9087-1834af73b0ac" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:54 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-70936ba7-3c9b-4d58-aacd-ca16eab2716f tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-quobyte-342fc080-ac73-4565-9087-1834af73b0ac" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:54 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-70936ba7-3c9b-4d58-aacd-ca16eab2716f tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "cinder-quobyte-48011912-0985-4bb9-adc8-17052fa6d5de" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:54 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-70936ba7-3c9b-4d58-aacd-ca16eab2716f tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-quobyte-48011912-0985-4bb9-adc8-17052fa6d5de" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:54 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-70936ba7-3c9b-4d58-aacd-ca16eab2716f tempest-CreateVolumesFromSnapshotTest-881659188 None] Deleting offline snapshot 48011912-0985-4bb9-adc8-17052fa6d5de of volume 342fc080-ac73-4565-9087-1834af73b0ac {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:43:54 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-70936ba7-3c9b-4d58-aacd-ca16eab2716f tempest-CreateVolumesFromSnapshotTest-881659188 None] snapshot_file for this snap is: volume-342fc080-ac73-4565-9087-1834af73b0ac.48011912-0985-4bb9-adc8-17052fa6d5de {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:43:54 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[542afc39-fa1e-4d24-9c0b-52a0cf8fb352]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:43:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-70936ba7-3c9b-4d58-aacd-ca16eab2716f tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac.48011912-0985-4bb9-adc8-17052fa6d5de {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:54 devstack sudo[86525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac.48011912-0985-4bb9-adc8-17052fa6d5de Apr 16 19:43:54 devstack sudo[86525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:54 devstack sudo[86510]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcd89cd1-4455-48e7-93ac-939fa769553b tempest-GroupSnapshotsV319Test-1496412250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6.info" returned: 0 in 1.071s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:54 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-bcd89cd1-4455-48e7-93ac-939fa769553b tempest-GroupSnapshotsV319Test-1496412250 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 19:43:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcd89cd1-4455-48e7-93ac-939fa769553b tempest-GroupSnapshotsV319Test-1496412250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:54 devstack sudo[86531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6.info Apr 16 19:43:54 devstack sudo[86531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:55 devstack sudo[86520]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e3897120-79a9-4d58-a56a-7c8e7fb2dcf9 tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 1.011s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:55 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-e3897120-79a9-4d58-a56a-7c8e7fb2dcf9 tempest-CreateVolumesFromSnapshotTest-881659188 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:43:55 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-e3897120-79a9-4d58-a56a-7c8e7fb2dcf9 tempest-CreateVolumesFromSnapshotTest-881659188 None] Deleted volume successfully. Apr 16 19:43:55 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e3897120-79a9-4d58-a56a-7c8e7fb2dcf9 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-3218cd85-da47-4063-9a90-4ddb7f1a19d7-delete_volume" released by "delete_volume" :: held 3.274s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:55 devstack sudo[86531]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcd89cd1-4455-48e7-93ac-939fa769553b tempest-GroupSnapshotsV319Test-1496412250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6.info" returned: 0 in 0.693s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bcd89cd1-4455-48e7-93ac-939fa769553b tempest-GroupSnapshotsV319Test-1496412250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.993s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:55 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-bcd89cd1-4455-48e7-93ac-939fa769553b tempest-GroupSnapshotsV319Test-1496412250 None] group_snapshot b2ab9aad-d72c-46ab-b65b-6c3066ad8def: created successfully Apr 16 19:43:55 devstack sudo[86525]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-70936ba7-3c9b-4d58-aacd-ca16eab2716f tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac.48011912-0985-4bb9-adc8-17052fa6d5de" returned: 0 in 1.063s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:55 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-70936ba7-3c9b-4d58-aacd-ca16eab2716f tempest-CreateVolumesFromSnapshotTest-881659188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-342fc080-ac73-4565-9087-1834af73b0ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:43:55 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e63eeb-a0d1-4a66-9b41-dbf5912d89d7]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:43:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-70936ba7-3c9b-4d58-aacd-ca16eab2716f tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:55 devstack sudo[86542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac Apr 16 19:43:55 devstack sudo[86542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:55 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-5a34a8d9-db79-4a04-99f3-8b804367a4ca tempest-GroupSnapshotsV319Test-1496412250 None] group_snapshot b2ab9aad-d72c-46ab-b65b-6c3066ad8def: deleting Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Flow 'volume_create_manager' (d626ff74-0865-4002-a23c-cd395ce6865c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec49824-1c82-4a19-9078-558952bdd34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec49824-1c82-4a19-9078-558952bdd34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-719089857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada93ba1-7450-44ce-9e4c-4cbc512f8dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129d6fa895144254aca1e7214fd325a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:56Z,use_quota=True,user_id='79f7f3c1fae24759a634497998925adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa5dd0a-09ba-4ed8-b6a9-82522dc206ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa5dd0a-09ba-4ed8-b6a9-82522dc206ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572e2fe8-61c5-43dd-af59-793ddc13e2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572e2fe8-61c5-43dd-af59-793ddc13e2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ada93ba1-7450-44ce-9e4c-4cbc512f8dee', 'volume_name': 'volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0efb686c-88c1-4c13-9efe-5b71e0ae0786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0efb686c-88c1-4c13-9efe-5b71e0ae0786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32bab1d5-927e-4abf-b3b5-f44f841d1ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:56 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Volume ada93ba1-7450-44ce-9e4c-4cbc512f8dee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee', 'volume_size': 1} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-719089857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada93ba1-7450-44ce-9e4c-4cbc512f8dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129d6fa895144254aca1e7214fd325a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:43:56Z,use_quota=True,user_id='79f7f3c1fae24759a634497998925adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Creating volume ada93ba1-7450-44ce-9e4c-4cbc512f8dee {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:43:56 devstack sudo[86542]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:43:56 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5a34a8d9-db79-4a04-99f3-8b804367a4ca tempest-GroupSnapshotsV319Test-1496412250 None] group_snapshot b2ab9aad-d72c-46ab-b65b-6c3066ad8def: deleting {{(pid=82569) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 16 19:43:56 devstack sudo[86547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee 1073741824 Apr 16 19:43:56 devstack sudo[86547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-70936ba7-3c9b-4d58-aacd-ca16eab2716f tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac" returned: 0 in 0.728s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-70936ba7-3c9b-4d58-aacd-ca16eab2716f tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac.48011912-0985-4bb9-adc8-17052fa6d5de {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5a34a8d9-db79-4a04-99f3-8b804367a4ca tempest-GroupSnapshotsV319Test-1496412250 None] Acquiring lock "cinder-quobyte-77649d1a-a050-4c3f-92cb-c4974191f4f6" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5a34a8d9-db79-4a04-99f3-8b804367a4ca tempest-GroupSnapshotsV319Test-1496412250 None] Lock "cinder-quobyte-77649d1a-a050-4c3f-92cb-c4974191f4f6" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5a34a8d9-db79-4a04-99f3-8b804367a4ca tempest-GroupSnapshotsV319Test-1496412250 None] Acquiring lock "cinder-quobyte-4f8604de-7967-4954-96be-af81b9a9d0c7" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:56 devstack sudo[86549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac.48011912-0985-4bb9-adc8-17052fa6d5de Apr 16 19:43:56 devstack sudo[86549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5a34a8d9-db79-4a04-99f3-8b804367a4ca tempest-GroupSnapshotsV319Test-1496412250 None] Lock "cinder-quobyte-4f8604de-7967-4954-96be-af81b9a9d0c7" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-5a34a8d9-db79-4a04-99f3-8b804367a4ca tempest-GroupSnapshotsV319Test-1496412250 None] Deleting offline snapshot 4f8604de-7967-4954-96be-af81b9a9d0c7 of volume 77649d1a-a050-4c3f-92cb-c4974191f4f6 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-5a34a8d9-db79-4a04-99f3-8b804367a4ca tempest-GroupSnapshotsV319Test-1496412250 None] snapshot_file for this snap is: volume-77649d1a-a050-4c3f-92cb-c4974191f4f6.4f8604de-7967-4954-96be-af81b9a9d0c7 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2bf8a1-47ab-4f62-ae08-c1ba90b44e78]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5a34a8d9-db79-4a04-99f3-8b804367a4ca tempest-GroupSnapshotsV319Test-1496412250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6.4f8604de-7967-4954-96be-af81b9a9d0c7 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:56 devstack sudo[86551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6.4f8604de-7967-4954-96be-af81b9a9d0c7 Apr 16 19:43:56 devstack sudo[86551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:56 devstack sudo[86547]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee 1073741824" returned: 0 in 0.595s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:56 devstack sudo[86549]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:56 devstack sudo[86562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee Apr 16 19:43:56 devstack sudo[86562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-70936ba7-3c9b-4d58-aacd-ca16eab2716f tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac.48011912-0985-4bb9-adc8-17052fa6d5de" returned: 0 in 0.631s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-70936ba7-3c9b-4d58-aacd-ca16eab2716f tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac.48011912-0985-4bb9-adc8-17052fa6d5de {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:56 devstack sudo[86564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac.48011912-0985-4bb9-adc8-17052fa6d5de Apr 16 19:43:56 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:56 devstack sudo[86551]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5a34a8d9-db79-4a04-99f3-8b804367a4ca tempest-GroupSnapshotsV319Test-1496412250 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6.4f8604de-7967-4954-96be-af81b9a9d0c7" returned: 0 in 0.617s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-5a34a8d9-db79-4a04-99f3-8b804367a4ca tempest-GroupSnapshotsV319Test-1496412250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77649d1a-a050-4c3f-92cb-c4974191f4f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[04486dfa-0054-4abd-a750-d413c79187a3]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:43:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5a34a8d9-db79-4a04-99f3-8b804367a4ca tempest-GroupSnapshotsV319Test-1496412250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:57 devstack sudo[86566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6 Apr 16 19:43:57 devstack sudo[86566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:57 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-70936ba7-3c9b-4d58-aacd-ca16eab2716f tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac.48011912-0985-4bb9-adc8-17052fa6d5de" returned: 0 in 0.606s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-70936ba7-3c9b-4d58-aacd-ca16eab2716f tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-quobyte-48011912-0985-4bb9-adc8-17052fa6d5de" released by "_delete_snapshot" :: held 3.137s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-70936ba7-3c9b-4d58-aacd-ca16eab2716f tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-quobyte-342fc080-ac73-4565-9087-1834af73b0ac" released by "delete_snapshot" :: held 3.167s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:57 devstack sudo[86562]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee" returned: 0 in 0.734s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:57 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:43:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:43:57 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32bab1d5-927e-4abf-b3b5-f44f841d1ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:57 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42a7dfe4-1498-45be-9d41-b68128eb9fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:43:57 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Volume volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee (ada93ba1-7450-44ce-9e4c-4cbc512f8dee): created successfully Apr 16 19:43:57 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42a7dfe4-1498-45be-9d41-b68128eb9fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:43:57 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Flow 'volume_create_manager' (d626ff74-0865-4002-a23c-cd395ce6865c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:43:57 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-70936ba7-3c9b-4d58-aacd-ca16eab2716f tempest-CreateVolumesFromSnapshotTest-881659188 None] Created reservations ['963333c8-df64-403d-b18e-83e2607d1083', '71de4a21-d3cb-4e08-9996-e2d95e59a19e', '1458ee19-f76c-4f5a-b4c4-1c73819d5e5a', '0cb38ee0-be7c-4c7f-8b28-41f896a251bf'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:43:57 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-c67d4d74-b6ac-4f8f-bd4a-bbe610cfb3fa tempest-SnapshotMetadataTestJSON-724588792 None] Created volume successfully. Apr 16 19:43:57 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-70936ba7-3c9b-4d58-aacd-ca16eab2716f tempest-CreateVolumesFromSnapshotTest-881659188 None] Delete snapshot completed successfully. Apr 16 19:43:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-70936ba7-3c9b-4d58-aacd-ca16eab2716f tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-48011912-0985-4bb9-adc8-17052fa6d5de-delete_snapshot" released by "delete_snapshot" :: held 3.336s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:57 devstack sudo[86566]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5a34a8d9-db79-4a04-99f3-8b804367a4ca tempest-GroupSnapshotsV319Test-1496412250 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6" returned: 0 in 0.842s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5a34a8d9-db79-4a04-99f3-8b804367a4ca tempest-GroupSnapshotsV319Test-1496412250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6.4f8604de-7967-4954-96be-af81b9a9d0c7 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:57 devstack sudo[86573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6.4f8604de-7967-4954-96be-af81b9a9d0c7 Apr 16 19:43:57 devstack sudo[86573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:58 devstack sudo[86573]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5a34a8d9-db79-4a04-99f3-8b804367a4ca tempest-GroupSnapshotsV319Test-1496412250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6.4f8604de-7967-4954-96be-af81b9a9d0c7" returned: 0 in 0.514s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5a34a8d9-db79-4a04-99f3-8b804367a4ca tempest-GroupSnapshotsV319Test-1496412250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6.4f8604de-7967-4954-96be-af81b9a9d0c7 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:58 devstack sudo[86578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6.4f8604de-7967-4954-96be-af81b9a9d0c7 Apr 16 19:43:58 devstack sudo[86578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ea407e8c-07b2-4cce-a939-218cb9f90d91 tempest-SnapshotMetadataTestJSON-724588792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:43:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ea407e8c-07b2-4cce-a939-218cb9f90d91 tempest-SnapshotMetadataTestJSON-724588792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:43:58 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-ea407e8c-07b2-4cce-a939-218cb9f90d91 tempest-SnapshotMetadataTestJSON-724588792 None] Creating offline snapshot 7faa0fab-2255-4bcf-a4c4-a9f07a6fc048 of volume ada93ba1-7450-44ce-9e4c-4cbc512f8dee {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:43:58 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d09b21-bb6e-4a0f-800a-39a487faec1f]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:43:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ea407e8c-07b2-4cce-a939-218cb9f90d91 tempest-SnapshotMetadataTestJSON-724588792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:58 devstack sudo[86580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee Apr 16 19:43:58 devstack sudo[86580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:58 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3cea2da9-a79c-4233-80cd-7988f74f0bf0 tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "cinder-342fc080-ac73-4565-9087-1834af73b0ac-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:58 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3cea2da9-a79c-4233-80cd-7988f74f0bf0 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-342fc080-ac73-4565-9087-1834af73b0ac-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:58 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3cea2da9-a79c-4233-80cd-7988f74f0bf0 tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "cinder-quobyte-342fc080-ac73-4565-9087-1834af73b0ac" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:58 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3cea2da9-a79c-4233-80cd-7988f74f0bf0 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-quobyte-342fc080-ac73-4565-9087-1834af73b0ac" acquired by "delete_volume" :: waited 0.014s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:58 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[432738d4-7f29-4fd4-bfd0-154edd347177]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:43:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3cea2da9-a79c-4233-80cd-7988f74f0bf0 tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:58 devstack sudo[86585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac Apr 16 19:43:58 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:58 devstack sudo[86578]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5a34a8d9-db79-4a04-99f3-8b804367a4ca tempest-GroupSnapshotsV319Test-1496412250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6.4f8604de-7967-4954-96be-af81b9a9d0c7" returned: 0 in 0.637s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:58 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5a34a8d9-db79-4a04-99f3-8b804367a4ca tempest-GroupSnapshotsV319Test-1496412250 None] Lock "cinder-quobyte-4f8604de-7967-4954-96be-af81b9a9d0c7" released by "_delete_snapshot" :: held 2.681s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:58 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5a34a8d9-db79-4a04-99f3-8b804367a4ca tempest-GroupSnapshotsV319Test-1496412250 None] Lock "cinder-quobyte-77649d1a-a050-4c3f-92cb-c4974191f4f6" released by "delete_snapshot" :: held 2.698s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:43:58 devstack cinder-volume[82569]: WARNING cinder.quota [None req-5a34a8d9-db79-4a04-99f3-8b804367a4ca tempest-GroupSnapshotsV319Test-1496412250 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1368621294 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1368621294, it is now deprecated. Please use the default quota class for default quota. Apr 16 19:43:58 devstack cinder-volume[82569]: WARNING cinder.quota [None req-5a34a8d9-db79-4a04-99f3-8b804367a4ca tempest-GroupSnapshotsV319Test-1496412250 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1368621294 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1368621294, it is now deprecated. Please use the default quota class for default quota. Apr 16 19:43:58 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-5a34a8d9-db79-4a04-99f3-8b804367a4ca tempest-GroupSnapshotsV319Test-1496412250 None] Created reservations ['783c2d0c-ae65-41db-9c26-5dd6e2006eb7', 'c3034327-9637-4836-af57-e692090c3a16', '0babb2f5-289c-4254-94bb-4a274359052a', '019f48b8-77bb-47a0-b50f-329de30bd2fd'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:43:58 devstack sudo[86580]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ea407e8c-07b2-4cce-a939-218cb9f90d91 tempest-SnapshotMetadataTestJSON-724588792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee" returned: 0 in 0.668s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ea407e8c-07b2-4cce-a939-218cb9f90d91 tempest-SnapshotMetadataTestJSON-724588792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee.7faa0fab-2255-4bcf-a4c4-a9f07a6fc048 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:59 devstack sudo[86591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee.7faa0fab-2255-4bcf-a4c4-a9f07a6fc048 1G Apr 16 19:43:59 devstack sudo[86591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:59 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-5a34a8d9-db79-4a04-99f3-8b804367a4ca tempest-GroupSnapshotsV319Test-1496412250 None] group_snapshot b2ab9aad-d72c-46ab-b65b-6c3066ad8def: deleted successfully Apr 16 19:43:59 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3cea2da9-a79c-4233-80cd-7988f74f0bf0 tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac" returned: 0 in 0.630s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3cea2da9-a79c-4233-80cd-7988f74f0bf0 tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:59 devstack sudo[86596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac Apr 16 19:43:59 devstack sudo[86596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a480945f-a3cd-4305-8f7c-69828a86142b tempest-GroupSnapshotsV319Test-1496412250 None] Acquiring lock "cinder-quobyte-77649d1a-a050-4c3f-92cb-c4974191f4f6" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:43:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a480945f-a3cd-4305-8f7c-69828a86142b tempest-GroupSnapshotsV319Test-1496412250 None] Lock "cinder-quobyte-77649d1a-a050-4c3f-92cb-c4974191f4f6" acquired by "delete_volume" :: waited 0.019s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:43:59 devstack sudo[86591]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ea407e8c-07b2-4cce-a939-218cb9f90d91 tempest-SnapshotMetadataTestJSON-724588792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee.7faa0fab-2255-4bcf-a4c4-a9f07a6fc048 1G" returned: 0 in 0.564s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ea407e8c-07b2-4cce-a939-218cb9f90d91 tempest-SnapshotMetadataTestJSON-724588792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee.7faa0fab-2255-4bcf-a4c4-a9f07a6fc048 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:59 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[66da9cab-ca3b-496d-8457-c05d453563ec]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:43:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a480945f-a3cd-4305-8f7c-69828a86142b tempest-GroupSnapshotsV319Test-1496412250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:43:59 devstack sudo[86601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee.7faa0fab-2255-4bcf-a4c4-a9f07a6fc048 Apr 16 19:43:59 devstack sudo[86601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:59 devstack sudo[86602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6 Apr 16 19:43:59 devstack sudo[86602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:43:59 devstack sudo[86596]: pam_unix(sudo:session): session closed for user root Apr 16 19:43:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3cea2da9-a79c-4233-80cd-7988f74f0bf0 tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-342fc080-ac73-4565-9087-1834af73b0ac" returned: 0 in 0.673s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:43:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3cea2da9-a79c-4233-80cd-7988f74f0bf0 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-quobyte-342fc080-ac73-4565-9087-1834af73b0ac" released by "delete_volume" :: held 1.341s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:44:00 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-3cea2da9-a79c-4233-80cd-7988f74f0bf0 tempest-CreateVolumesFromSnapshotTest-881659188 None] Created reservations ['2f6497a7-ef9d-4882-8cf5-fc9eab1dc3be', 'b7abc75f-3d92-4052-8870-de5a3c7dc8f9', 'e2e45954-f058-44cd-a325-7be7a0364da3', '9e7f451f-975b-4a6c-a590-e738325c50ba'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:44:00 devstack sudo[86602]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a480945f-a3cd-4305-8f7c-69828a86142b tempest-GroupSnapshotsV319Test-1496412250 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6" returned: 0 in 0.663s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a480945f-a3cd-4305-8f7c-69828a86142b tempest-GroupSnapshotsV319Test-1496412250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:00 devstack sudo[86636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6 Apr 16 19:44:00 devstack sudo[86636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3cea2da9-a79c-4233-80cd-7988f74f0bf0 tempest-CreateVolumesFromSnapshotTest-881659188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3cea2da9-a79c-4233-80cd-7988f74f0bf0 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:00 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3cea2da9-a79c-4233-80cd-7988f74f0bf0 tempest-CreateVolumesFromSnapshotTest-881659188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:44:00 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3cea2da9-a79c-4233-80cd-7988f74f0bf0 tempest-CreateVolumesFromSnapshotTest-881659188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:44:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3cea2da9-a79c-4233-80cd-7988f74f0bf0 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3cea2da9-a79c-4233-80cd-7988f74f0bf0 tempest-CreateVolumesFromSnapshotTest-881659188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:00 devstack sudo[86639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:44:00 devstack sudo[86639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:00 devstack sudo[86601]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ea407e8c-07b2-4cce-a939-218cb9f90d91 tempest-SnapshotMetadataTestJSON-724588792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee.7faa0fab-2255-4bcf-a4c4-a9f07a6fc048" returned: 0 in 0.979s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:00 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-ea407e8c-07b2-4cce-a939-218cb9f90d91 tempest-SnapshotMetadataTestJSON-724588792 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee.7faa0fab-2255-4bcf-a4c4-a9f07a6fc048 is being set with open permissions: ugo+rw Apr 16 19:44:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ea407e8c-07b2-4cce-a939-218cb9f90d91 tempest-SnapshotMetadataTestJSON-724588792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee.7faa0fab-2255-4bcf-a4c4-a9f07a6fc048 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:00 devstack sudo[86643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee.7faa0fab-2255-4bcf-a4c4-a9f07a6fc048 Apr 16 19:44:00 devstack sudo[86643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:01 devstack sudo[86639]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3cea2da9-a79c-4233-80cd-7988f74f0bf0 tempest-CreateVolumesFromSnapshotTest-881659188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 1.236s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:01 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-3cea2da9-a79c-4233-80cd-7988f74f0bf0 tempest-CreateVolumesFromSnapshotTest-881659188 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:44:01 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-3cea2da9-a79c-4233-80cd-7988f74f0bf0 tempest-CreateVolumesFromSnapshotTest-881659188 None] Deleted volume successfully. Apr 16 19:44:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3cea2da9-a79c-4233-80cd-7988f74f0bf0 tempest-CreateVolumesFromSnapshotTest-881659188 None] Lock "cinder-342fc080-ac73-4565-9087-1834af73b0ac-delete_volume" released by "delete_volume" :: held 3.156s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:44:01 devstack sudo[86636]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a480945f-a3cd-4305-8f7c-69828a86142b tempest-GroupSnapshotsV319Test-1496412250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-77649d1a-a050-4c3f-92cb-c4974191f4f6" returned: 0 in 1.441s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a480945f-a3cd-4305-8f7c-69828a86142b tempest-GroupSnapshotsV319Test-1496412250 None] Lock "cinder-quobyte-77649d1a-a050-4c3f-92cb-c4974191f4f6" released by "delete_volume" :: held 2.176s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:44:01 devstack sudo[86643]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ea407e8c-07b2-4cce-a939-218cb9f90d91 tempest-SnapshotMetadataTestJSON-724588792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee.7faa0fab-2255-4bcf-a4c4-a9f07a6fc048" returned: 0 in 1.205s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ea407e8c-07b2-4cce-a939-218cb9f90d91 tempest-SnapshotMetadataTestJSON-724588792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:01 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-a480945f-a3cd-4305-8f7c-69828a86142b tempest-GroupSnapshotsV319Test-1496412250 None] Created reservations ['53ad1506-d115-4fa8-bcec-e76aa2558a38'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:44:01 devstack sudo[86650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee.info Apr 16 19:44:01 devstack sudo[86650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:01 devstack cinder-volume[82569]: WARNING cinder.quota [None req-a480945f-a3cd-4305-8f7c-69828a86142b tempest-GroupSnapshotsV319Test-1496412250 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1368621294 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1368621294, it is now deprecated. Please use the default quota class for default quota. Apr 16 19:44:01 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-a480945f-a3cd-4305-8f7c-69828a86142b tempest-GroupSnapshotsV319Test-1496412250 None] Created reservations ['1cd80f96-b06b-4535-846c-9242d44e6279', '5c66d3a1-7d92-44ee-8b9b-81ce0a20ac20', 'f2d8e7c6-3a28-4b73-8299-3b53562b17d0', 'cb77b6d1-56ee-4b22-8a29-f7f756358722'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:44:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a480945f-a3cd-4305-8f7c-69828a86142b tempest-GroupSnapshotsV319Test-1496412250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a480945f-a3cd-4305-8f7c-69828a86142b tempest-GroupSnapshotsV319Test-1496412250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:02 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-a480945f-a3cd-4305-8f7c-69828a86142b tempest-GroupSnapshotsV319Test-1496412250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:44:02 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-a480945f-a3cd-4305-8f7c-69828a86142b tempest-GroupSnapshotsV319Test-1496412250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:44:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a480945f-a3cd-4305-8f7c-69828a86142b tempest-GroupSnapshotsV319Test-1496412250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a480945f-a3cd-4305-8f7c-69828a86142b tempest-GroupSnapshotsV319Test-1496412250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:02 devstack sudo[86652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:44:02 devstack sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:02 devstack sudo[86650]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ea407e8c-07b2-4cce-a939-218cb9f90d91 tempest-SnapshotMetadataTestJSON-724588792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee.info" returned: 0 in 0.875s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:02 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-ea407e8c-07b2-4cce-a939-218cb9f90d91 tempest-SnapshotMetadataTestJSON-724588792 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee.info is being set with open permissions: ugo+rw Apr 16 19:44:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ea407e8c-07b2-4cce-a939-218cb9f90d91 tempest-SnapshotMetadataTestJSON-724588792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:02 devstack sudo[86657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee.info Apr 16 19:44:02 devstack sudo[86657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:02 devstack sudo[86652]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a480945f-a3cd-4305-8f7c-69828a86142b tempest-GroupSnapshotsV319Test-1496412250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.678s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:02 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-a480945f-a3cd-4305-8f7c-69828a86142b tempest-GroupSnapshotsV319Test-1496412250 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:44:02 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-a480945f-a3cd-4305-8f7c-69828a86142b tempest-GroupSnapshotsV319Test-1496412250 None] Delete group completed successfully. Apr 16 19:44:03 devstack sudo[86657]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ea407e8c-07b2-4cce-a939-218cb9f90d91 tempest-SnapshotMetadataTestJSON-724588792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee.info" returned: 0 in 1.023s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ea407e8c-07b2-4cce-a939-218cb9f90d91 tempest-SnapshotMetadataTestJSON-724588792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.383s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:03 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-ea407e8c-07b2-4cce-a939-218cb9f90d91 tempest-SnapshotMetadataTestJSON-724588792 None] Create snapshot completed successfully Apr 16 19:44:04 devstack cinder-volume[82569]: DEBUG oslo_service.periodic_task [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82569) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 19:44:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:44:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:44:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:04 devstack sudo[86663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:44:04 devstack sudo[86663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:04 devstack sudo[86663]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.586s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:04 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:44:05 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d40ca96e-7284-4c6d-a1ee-dfdda9b51a86 tempest-SnapshotMetadataTestJSON-724588792 None] Acquiring lock "cinder-7faa0fab-2255-4bcf-a4c4-a9f07a6fc048-delete_snapshot" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:44:05 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d40ca96e-7284-4c6d-a1ee-dfdda9b51a86 tempest-SnapshotMetadataTestJSON-724588792 None] Lock "cinder-7faa0fab-2255-4bcf-a4c4-a9f07a6fc048-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:44:05 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d40ca96e-7284-4c6d-a1ee-dfdda9b51a86 tempest-SnapshotMetadataTestJSON-724588792 None] Acquiring lock "cinder-quobyte-ada93ba1-7450-44ce-9e4c-4cbc512f8dee" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:44:05 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d40ca96e-7284-4c6d-a1ee-dfdda9b51a86 tempest-SnapshotMetadataTestJSON-724588792 None] Lock "cinder-quobyte-ada93ba1-7450-44ce-9e4c-4cbc512f8dee" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:44:05 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d40ca96e-7284-4c6d-a1ee-dfdda9b51a86 tempest-SnapshotMetadataTestJSON-724588792 None] Acquiring lock "cinder-quobyte-7faa0fab-2255-4bcf-a4c4-a9f07a6fc048" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:44:05 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d40ca96e-7284-4c6d-a1ee-dfdda9b51a86 tempest-SnapshotMetadataTestJSON-724588792 None] Lock "cinder-quobyte-7faa0fab-2255-4bcf-a4c4-a9f07a6fc048" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:44:05 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-d40ca96e-7284-4c6d-a1ee-dfdda9b51a86 tempest-SnapshotMetadataTestJSON-724588792 None] Deleting offline snapshot 7faa0fab-2255-4bcf-a4c4-a9f07a6fc048 of volume ada93ba1-7450-44ce-9e4c-4cbc512f8dee {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:44:05 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-d40ca96e-7284-4c6d-a1ee-dfdda9b51a86 tempest-SnapshotMetadataTestJSON-724588792 None] snapshot_file for this snap is: volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee.7faa0fab-2255-4bcf-a4c4-a9f07a6fc048 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:44:05 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ce20a6-0c0d-4320-bb9e-fc24700c7bd9]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:44:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d40ca96e-7284-4c6d-a1ee-dfdda9b51a86 tempest-SnapshotMetadataTestJSON-724588792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee.7faa0fab-2255-4bcf-a4c4-a9f07a6fc048 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:05 devstack sudo[86692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee.7faa0fab-2255-4bcf-a4c4-a9f07a6fc048 Apr 16 19:44:05 devstack sudo[86692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:06 devstack sudo[86692]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d40ca96e-7284-4c6d-a1ee-dfdda9b51a86 tempest-SnapshotMetadataTestJSON-724588792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee.7faa0fab-2255-4bcf-a4c4-a9f07a6fc048" returned: 0 in 0.671s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:06 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-d40ca96e-7284-4c6d-a1ee-dfdda9b51a86 tempest-SnapshotMetadataTestJSON-724588792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:44:06 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[97836d8b-5409-45e8-80a4-2e7a3dd294fe]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:44:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d40ca96e-7284-4c6d-a1ee-dfdda9b51a86 tempest-SnapshotMetadataTestJSON-724588792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:06 devstack sudo[86698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee Apr 16 19:44:06 devstack sudo[86698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:06 devstack sudo[86698]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d40ca96e-7284-4c6d-a1ee-dfdda9b51a86 tempest-SnapshotMetadataTestJSON-724588792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee" returned: 0 in 0.600s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d40ca96e-7284-4c6d-a1ee-dfdda9b51a86 tempest-SnapshotMetadataTestJSON-724588792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee.7faa0fab-2255-4bcf-a4c4-a9f07a6fc048 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:06 devstack sudo[86705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee.7faa0fab-2255-4bcf-a4c4-a9f07a6fc048 Apr 16 19:44:06 devstack sudo[86705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:07 devstack sudo[86705]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d40ca96e-7284-4c6d-a1ee-dfdda9b51a86 tempest-SnapshotMetadataTestJSON-724588792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee.7faa0fab-2255-4bcf-a4c4-a9f07a6fc048" returned: 0 in 0.477s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d40ca96e-7284-4c6d-a1ee-dfdda9b51a86 tempest-SnapshotMetadataTestJSON-724588792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee.7faa0fab-2255-4bcf-a4c4-a9f07a6fc048 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:07 devstack sudo[86712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee.7faa0fab-2255-4bcf-a4c4-a9f07a6fc048 Apr 16 19:44:07 devstack sudo[86712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:07 devstack sudo[86712]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d40ca96e-7284-4c6d-a1ee-dfdda9b51a86 tempest-SnapshotMetadataTestJSON-724588792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee.7faa0fab-2255-4bcf-a4c4-a9f07a6fc048" returned: 0 in 0.609s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:07 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d40ca96e-7284-4c6d-a1ee-dfdda9b51a86 tempest-SnapshotMetadataTestJSON-724588792 None] Lock "cinder-quobyte-7faa0fab-2255-4bcf-a4c4-a9f07a6fc048" released by "_delete_snapshot" :: held 2.435s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:44:07 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d40ca96e-7284-4c6d-a1ee-dfdda9b51a86 tempest-SnapshotMetadataTestJSON-724588792 None] Lock "cinder-quobyte-ada93ba1-7450-44ce-9e4c-4cbc512f8dee" released by "delete_snapshot" :: held 2.455s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:44:07 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-d40ca96e-7284-4c6d-a1ee-dfdda9b51a86 tempest-SnapshotMetadataTestJSON-724588792 None] Created reservations ['54d2861a-3bd6-4371-85c5-fd64f993f3da', '44c15556-4653-4cba-b622-2e4dfa5e5b04', 'b98f323c-ac92-4701-91af-4d1b9d26b3c8', 'da3afabc-ec3c-4b49-9972-c1061c3fb396'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:44:07 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-d40ca96e-7284-4c6d-a1ee-dfdda9b51a86 tempest-SnapshotMetadataTestJSON-724588792 None] Delete snapshot completed successfully. Apr 16 19:44:07 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d40ca96e-7284-4c6d-a1ee-dfdda9b51a86 tempest-SnapshotMetadataTestJSON-724588792 None] Lock "cinder-7faa0fab-2255-4bcf-a4c4-a9f07a6fc048-delete_snapshot" released by "delete_snapshot" :: held 2.582s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:44:08 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-53cdda0e-811b-4e17-8031-760bad996596 tempest-SnapshotMetadataTestJSON-724588792 None] Acquiring lock "cinder-ada93ba1-7450-44ce-9e4c-4cbc512f8dee-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:44:08 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-53cdda0e-811b-4e17-8031-760bad996596 tempest-SnapshotMetadataTestJSON-724588792 None] Lock "cinder-ada93ba1-7450-44ce-9e4c-4cbc512f8dee-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:44:08 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-53cdda0e-811b-4e17-8031-760bad996596 tempest-SnapshotMetadataTestJSON-724588792 None] Acquiring lock "cinder-quobyte-ada93ba1-7450-44ce-9e4c-4cbc512f8dee" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:44:08 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-53cdda0e-811b-4e17-8031-760bad996596 tempest-SnapshotMetadataTestJSON-724588792 None] Lock "cinder-quobyte-ada93ba1-7450-44ce-9e4c-4cbc512f8dee" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:44:08 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3221bf-70f9-48f4-8885-2b4343749d44]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:44:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-53cdda0e-811b-4e17-8031-760bad996596 tempest-SnapshotMetadataTestJSON-724588792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:08 devstack sudo[86721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee Apr 16 19:44:08 devstack sudo[86721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:09 devstack sudo[86721]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-53cdda0e-811b-4e17-8031-760bad996596 tempest-SnapshotMetadataTestJSON-724588792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee" returned: 0 in 0.619s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-53cdda0e-811b-4e17-8031-760bad996596 tempest-SnapshotMetadataTestJSON-724588792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:09 devstack sudo[86728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee Apr 16 19:44:09 devstack sudo[86728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:09 devstack sudo[86728]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-53cdda0e-811b-4e17-8031-760bad996596 tempest-SnapshotMetadataTestJSON-724588792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ada93ba1-7450-44ce-9e4c-4cbc512f8dee" returned: 0 in 0.546s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:09 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-53cdda0e-811b-4e17-8031-760bad996596 tempest-SnapshotMetadataTestJSON-724588792 None] Lock "cinder-quobyte-ada93ba1-7450-44ce-9e4c-4cbc512f8dee" released by "delete_volume" :: held 1.195s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:44:09 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-53cdda0e-811b-4e17-8031-760bad996596 tempest-SnapshotMetadataTestJSON-724588792 None] Created reservations ['e8c59ed9-749e-4632-a4d6-2e0a556c35a9', '21440de9-0493-49e2-91cd-0aa518ebfe62', 'c71515fd-fa32-4f1f-854c-110563e10de8', '8a06454b-f6a8-4969-a69e-9afd2c1160f5'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:44:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-53cdda0e-811b-4e17-8031-760bad996596 tempest-SnapshotMetadataTestJSON-724588792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-53cdda0e-811b-4e17-8031-760bad996596 tempest-SnapshotMetadataTestJSON-724588792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:09 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-53cdda0e-811b-4e17-8031-760bad996596 tempest-SnapshotMetadataTestJSON-724588792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:44:09 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-53cdda0e-811b-4e17-8031-760bad996596 tempest-SnapshotMetadataTestJSON-724588792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:44:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-53cdda0e-811b-4e17-8031-760bad996596 tempest-SnapshotMetadataTestJSON-724588792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-53cdda0e-811b-4e17-8031-760bad996596 tempest-SnapshotMetadataTestJSON-724588792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:09 devstack sudo[86731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:44:09 devstack sudo[86731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:10 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:44:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Flow 'volume_create_manager' (ab75f224-e33b-475c-8ee9-a9f696894ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:44:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e52950-46f7-4cef-a5a1-d4e7e79077b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e52950-46f7-4cef-a5a1-d4e7e79077b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-212296648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc197412-8a11-4c40-b939-a5835867cf41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fbf40fb39d74f0a9248e0fd4a7d090a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:44:10Z,use_quota=True,user_id='5ff079f2de4a4f72919f042b6a0b8173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e57bd07-e177-4501-86b1-e300e27dff3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e57bd07-e177-4501-86b1-e300e27dff3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0596d64-21e9-44bf-aca9-45bd85947447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0596d64-21e9-44bf-aca9-45bd85947447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc197412-8a11-4c40-b939-a5835867cf41', 'volume_name': 'volume-dc197412-8a11-4c40-b939-a5835867cf41', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1de17e6-ddc3-4b9d-9380-e6a8c0dee8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1de17e6-ddc3-4b9d-9380-e6a8c0dee8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6bbb566-e3b1-4121-94da-46d5b71dd11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:10 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Volume dc197412-8a11-4c40-b939-a5835867cf41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc197412-8a11-4c40-b939-a5835867cf41', 'volume_size': 1} Apr 16 19:44:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:10 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-212296648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc197412-8a11-4c40-b939-a5835867cf41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fbf40fb39d74f0a9248e0fd4a7d090a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:44:10Z,use_quota=True,user_id='5ff079f2de4a4f72919f042b6a0b8173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:44:10 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Creating volume dc197412-8a11-4c40-b939-a5835867cf41 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:44:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:10 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:44:10 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:44:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:10 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:44:10 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:44:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dc197412-8a11-4c40-b939-a5835867cf41 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:10 devstack sudo[86749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dc197412-8a11-4c40-b939-a5835867cf41 1073741824 Apr 16 19:44:10 devstack sudo[86749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:10 devstack sudo[86731]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-53cdda0e-811b-4e17-8031-760bad996596 tempest-SnapshotMetadataTestJSON-724588792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.679s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:10 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-53cdda0e-811b-4e17-8031-760bad996596 tempest-SnapshotMetadataTestJSON-724588792 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:44:10 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-53cdda0e-811b-4e17-8031-760bad996596 tempest-SnapshotMetadataTestJSON-724588792 None] Deleted volume successfully. Apr 16 19:44:10 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-53cdda0e-811b-4e17-8031-760bad996596 tempest-SnapshotMetadataTestJSON-724588792 None] Lock "cinder-ada93ba1-7450-44ce-9e4c-4cbc512f8dee-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:44:11 devstack sudo[86749]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dc197412-8a11-4c40-b939-a5835867cf41 1073741824" returned: 0 in 0.829s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dc197412-8a11-4c40-b939-a5835867cf41 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:11 devstack sudo[86789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dc197412-8a11-4c40-b939-a5835867cf41 Apr 16 19:44:11 devstack sudo[86789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:11 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-66bc988b-254c-463a-aea2-44ddb03fd2c9 tempest-GroupsTest-271104784 None] Group tempest-Group1-2134987156: creating Apr 16 19:44:11 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-66bc988b-254c-463a-aea2-44ddb03fd2c9 tempest-GroupsTest-271104784 None] Group tempest-Group1-2134987156: created successfully Apr 16 19:44:11 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-66bc988b-254c-463a-aea2-44ddb03fd2c9 tempest-GroupsTest-271104784 None] Create group completed successfully. Apr 16 19:44:11 devstack sudo[86789]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dc197412-8a11-4c40-b939-a5835867cf41" returned: 0 in 0.570s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:11 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:44:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:11 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6bbb566-e3b1-4121-94da-46d5b71dd11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc197412-8a11-4c40-b939-a5835867cf41', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:11 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ecfbee-55b2-4f2d-a64c-19e04777bf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:11 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Volume volume-dc197412-8a11-4c40-b939-a5835867cf41 (dc197412-8a11-4c40-b939-a5835867cf41): created successfully Apr 16 19:44:11 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ecfbee-55b2-4f2d-a64c-19e04777bf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:11 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Flow 'volume_create_manager' (ab75f224-e33b-475c-8ee9-a9f696894ebd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:44:11 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-d1ee08d9-1e0f-4fbf-970e-adc0db0b17dd tempest-ServersNegativeTestJSON-692949403 None] Created volume successfully. Apr 16 19:44:12 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-0c7b9436-136d-4edd-9ad4-c2118cf1d584 tempest-GroupsTest-271104784 None] Group tempest-Group2-1876611102: creating Apr 16 19:44:12 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-0c7b9436-136d-4edd-9ad4-c2118cf1d584 tempest-GroupsTest-271104784 None] Group tempest-Group2-1876611102: created successfully Apr 16 19:44:12 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-0c7b9436-136d-4edd-9ad4-c2118cf1d584 tempest-GroupsTest-271104784 None] Create group completed successfully. Apr 16 19:44:13 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:44:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Flow 'volume_create_manager' (22637143-29fb-44a5-8fc7-5e1531cbd6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:44:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d52ebc28-2bb6-446d-9ba5-da14022c826e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d52ebc28-2bb6-446d-9ba5-da14022c826e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1533311908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65686cc3-4b80-40eb-9a4f-c37543b4e705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fbf40fb39d74f0a9248e0fd4a7d090a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:44:13Z,use_quota=True,user_id='5ff079f2de4a4f72919f042b6a0b8173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be0cf32-168b-4406-99b0-e3f3f576cad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be0cf32-168b-4406-99b0-e3f3f576cad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea55ae5-a005-430a-87cb-fbb513bb080e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea55ae5-a005-430a-87cb-fbb513bb080e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65686cc3-4b80-40eb-9a4f-c37543b4e705', 'volume_name': 'volume-65686cc3-4b80-40eb-9a4f-c37543b4e705', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf49b0fa-a389-4d29-ad49-50a7a86fd959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf49b0fa-a389-4d29-ad49-50a7a86fd959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f193df07-433a-405f-8d96-50156b99505f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:13 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Volume 65686cc3-4b80-40eb-9a4f-c37543b4e705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65686cc3-4b80-40eb-9a4f-c37543b4e705', 'volume_size': 1} Apr 16 19:44:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:13 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1533311908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65686cc3-4b80-40eb-9a4f-c37543b4e705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fbf40fb39d74f0a9248e0fd4a7d090a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:44:13Z,use_quota=True,user_id='5ff079f2de4a4f72919f042b6a0b8173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:44:13 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Creating volume 65686cc3-4b80-40eb-9a4f-c37543b4e705 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:44:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:13 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:44:13 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:44:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:13 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:44:13 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:44:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-65686cc3-4b80-40eb-9a4f-c37543b4e705 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:13 devstack sudo[86793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-65686cc3-4b80-40eb-9a4f-c37543b4e705 1073741824 Apr 16 19:44:13 devstack sudo[86793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:14 devstack sudo[86793]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-65686cc3-4b80-40eb-9a4f-c37543b4e705 1073741824" returned: 0 in 0.659s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-65686cc3-4b80-40eb-9a4f-c37543b4e705 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:14 devstack sudo[86798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-65686cc3-4b80-40eb-9a4f-c37543b4e705 Apr 16 19:44:14 devstack sudo[86798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Flow 'volume_create_manager' (e7c9aabc-1393-4763-af98-3993d287403c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10feeade-1e4b-4832-8474-6deeaaf6cf59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10feeade-1e4b-4832-8474-6deeaaf6cf59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1061357289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd65723d-a1f0-4dc5-a543-10703c17b2f6,host='devstack@QuobyteHD#QuobyteHD',id=7b473e43-f12c-4c43-aa31-413e7ce357e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee583c738e6f49cca49a557acc27f19c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:44:14Z,use_quota=True,user_id='d70a6bef996a4c0e9b8575481c2c0a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61f2f1e4-92f9-4528-9f25-e8e16ba702cf),volume_type_id=61f2f1e4-92f9-4528-9f25-e8e16ba702cf)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de7992d-bfe3-4beb-8361-e083850a17fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de7992d-bfe3-4beb-8361-e083850a17fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c7e512e-1af2-4283-807a-f112eeeef735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c7e512e-1af2-4283-807a-f112eeeef735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b473e43-f12c-4c43-aa31-413e7ce357e0', 'volume_name': 'volume-7b473e43-f12c-4c43-aa31-413e7ce357e0', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60519d73-47fb-4b0a-b2c9-3727b836cb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60519d73-47fb-4b0a-b2c9-3727b836cb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c7982ff-7f1c-4240-afe6-eaf3ecc32c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:14 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Volume 7b473e43-f12c-4c43-aa31-413e7ce357e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b473e43-f12c-4c43-aa31-413e7ce357e0', 'volume_size': 1} Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:14 devstack sudo[86798]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-65686cc3-4b80-40eb-9a4f-c37543b4e705" returned: 0 in 0.518s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.385s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bd65723d-a1f0-4dc5-a543-10703c17b2f6,created_at=2026-04-16T17:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1061357289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd65723d-a1f0-4dc5-a543-10703c17b2f6,host='devstack@QuobyteHD#QuobyteHD',id=7b473e43-f12c-4c43-aa31-413e7ce357e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee583c738e6f49cca49a557acc27f19c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:44:14Z,use_quota=True,user_id='d70a6bef996a4c0e9b8575481c2c0a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61f2f1e4-92f9-4528-9f25-e8e16ba702cf),volume_type_id=61f2f1e4-92f9-4528-9f25-e8e16ba702cf)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Creating volume 7b473e43-f12c-4c43-aa31-413e7ce357e0 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:44:14 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b473e43-f12c-4c43-aa31-413e7ce357e0 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f193df07-433a-405f-8d96-50156b99505f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65686cc3-4b80-40eb-9a4f-c37543b4e705', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:14 devstack sudo[86801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b473e43-f12c-4c43-aa31-413e7ce357e0 1073741824 Apr 16 19:44:14 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d4b6854-6d75-43f3-b966-e01345a67cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:14 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Volume volume-65686cc3-4b80-40eb-9a4f-c37543b4e705 (65686cc3-4b80-40eb-9a4f-c37543b4e705): created successfully Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d4b6854-6d75-43f3-b966-e01345a67cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Flow 'volume_create_manager' (22637143-29fb-44a5-8fc7-5e1531cbd6b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:44:14 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-5d1fb78c-b0a9-4d89-8b02-98fd9e0e00d0 tempest-ServersNegativeTestJSON-692949403 None] Created volume successfully. Apr 16 19:44:15 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b473e43-f12c-4c43-aa31-413e7ce357e0 1073741824" returned: 0 in 0.524s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b473e43-f12c-4c43-aa31-413e7ce357e0 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:15 devstack sudo[86806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b473e43-f12c-4c43-aa31-413e7ce357e0 Apr 16 19:44:15 devstack sudo[86806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:15 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c20c4e78-b5c9-46ff-90c8-c2c847e623c2 tempest-ServersNegativeTestJSON-692949403 None] Acquiring lock "cinder-65686cc3-4b80-40eb-9a4f-c37543b4e705-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:44:15 devstack sudo[86806]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b473e43-f12c-4c43-aa31-413e7ce357e0" returned: 0 in 0.617s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:15 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:44:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:15 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c20c4e78-b5c9-46ff-90c8-c2c847e623c2 tempest-ServersNegativeTestJSON-692949403 None] Lock "cinder-65686cc3-4b80-40eb-9a4f-c37543b4e705-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:44:15 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c7982ff-7f1c-4240-afe6-eaf3ecc32c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b473e43-f12c-4c43-aa31-413e7ce357e0', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:15 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce05061-3999-442d-a8eb-5e219339433a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:15 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Volume volume-7b473e43-f12c-4c43-aa31-413e7ce357e0 (7b473e43-f12c-4c43-aa31-413e7ce357e0): created successfully Apr 16 19:44:15 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce05061-3999-442d-a8eb-5e219339433a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:15 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Flow 'volume_create_manager' (e7c9aabc-1393-4763-af98-3993d287403c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:44:15 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-6d5065bb-a3da-4aa3-acdc-12a28b7d7201 tempest-GroupsTest-271104784 None] Created volume successfully. Apr 16 19:44:15 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c20c4e78-b5c9-46ff-90c8-c2c847e623c2 tempest-ServersNegativeTestJSON-692949403 None] Acquiring lock "cinder-quobyte-65686cc3-4b80-40eb-9a4f-c37543b4e705" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:44:15 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c20c4e78-b5c9-46ff-90c8-c2c847e623c2 tempest-ServersNegativeTestJSON-692949403 None] Lock "cinder-quobyte-65686cc3-4b80-40eb-9a4f-c37543b4e705" acquired by "delete_volume" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:44:15 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30459c8-8755-4040-bc27-a5b17e1aff47]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:44:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c20c4e78-b5c9-46ff-90c8-c2c847e623c2 tempest-ServersNegativeTestJSON-692949403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-65686cc3-4b80-40eb-9a4f-c37543b4e705 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:15 devstack sudo[86809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-65686cc3-4b80-40eb-9a4f-c37543b4e705 Apr 16 19:44:15 devstack sudo[86809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:16 devstack sudo[86809]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c20c4e78-b5c9-46ff-90c8-c2c847e623c2 tempest-ServersNegativeTestJSON-692949403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-65686cc3-4b80-40eb-9a4f-c37543b4e705" returned: 0 in 0.602s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c20c4e78-b5c9-46ff-90c8-c2c847e623c2 tempest-ServersNegativeTestJSON-692949403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-65686cc3-4b80-40eb-9a4f-c37543b4e705 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:16 devstack sudo[86814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-65686cc3-4b80-40eb-9a4f-c37543b4e705 Apr 16 19:44:16 devstack sudo[86814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:16 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3d02f98a-6bdb-4d7f-8ae7-96429a1695f5 tempest-GroupsTest-271104784 None] Acquiring lock "cinder-quobyte-7b473e43-f12c-4c43-aa31-413e7ce357e0" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:44:17 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3d02f98a-6bdb-4d7f-8ae7-96429a1695f5 tempest-GroupsTest-271104784 None] Lock "cinder-quobyte-7b473e43-f12c-4c43-aa31-413e7ce357e0" acquired by "delete_volume" :: waited 0.014s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:44:17 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54cc178-93aa-485b-a713-ce5ffdb1f26d]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:44:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3d02f98a-6bdb-4d7f-8ae7-96429a1695f5 tempest-GroupsTest-271104784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b473e43-f12c-4c43-aa31-413e7ce357e0 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:17 devstack sudo[86816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b473e43-f12c-4c43-aa31-413e7ce357e0 Apr 16 19:44:17 devstack sudo[86816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:17 devstack sudo[86814]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c20c4e78-b5c9-46ff-90c8-c2c847e623c2 tempest-ServersNegativeTestJSON-692949403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-65686cc3-4b80-40eb-9a4f-c37543b4e705" returned: 0 in 0.787s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:17 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c20c4e78-b5c9-46ff-90c8-c2c847e623c2 tempest-ServersNegativeTestJSON-692949403 None] Lock "cinder-quobyte-65686cc3-4b80-40eb-9a4f-c37543b4e705" released by "delete_volume" :: held 1.413s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:44:17 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-c20c4e78-b5c9-46ff-90c8-c2c847e623c2 tempest-ServersNegativeTestJSON-692949403 None] Created reservations ['2545456b-7e83-4c7f-a518-009a5bf6e411', 'b2435e5e-0497-4684-9074-4599de765faa', '7095e085-6988-4336-8d85-de6ad9192f65', 'ee874375-fcae-4d7c-9d19-abc4d3a4c855'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:44:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-c20c4e78-b5c9-46ff-90c8-c2c847e623c2 tempest-ServersNegativeTestJSON-692949403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-c20c4e78-b5c9-46ff-90c8-c2c847e623c2 tempest-ServersNegativeTestJSON-692949403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:17 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-c20c4e78-b5c9-46ff-90c8-c2c847e623c2 tempest-ServersNegativeTestJSON-692949403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:44:17 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-c20c4e78-b5c9-46ff-90c8-c2c847e623c2 tempest-ServersNegativeTestJSON-692949403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:44:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-c20c4e78-b5c9-46ff-90c8-c2c847e623c2 tempest-ServersNegativeTestJSON-692949403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c20c4e78-b5c9-46ff-90c8-c2c847e623c2 tempest-ServersNegativeTestJSON-692949403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:17 devstack sudo[86819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:44:17 devstack sudo[86819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:17 devstack sudo[86816]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3d02f98a-6bdb-4d7f-8ae7-96429a1695f5 tempest-GroupsTest-271104784 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b473e43-f12c-4c43-aa31-413e7ce357e0" returned: 0 in 0.624s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3d02f98a-6bdb-4d7f-8ae7-96429a1695f5 tempest-GroupsTest-271104784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b473e43-f12c-4c43-aa31-413e7ce357e0 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:17 devstack sudo[86824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b473e43-f12c-4c43-aa31-413e7ce357e0 Apr 16 19:44:17 devstack sudo[86824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:17 devstack sudo[86819]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c20c4e78-b5c9-46ff-90c8-c2c847e623c2 tempest-ServersNegativeTestJSON-692949403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.531s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:17 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-c20c4e78-b5c9-46ff-90c8-c2c847e623c2 tempest-ServersNegativeTestJSON-692949403 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:44:17 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-c20c4e78-b5c9-46ff-90c8-c2c847e623c2 tempest-ServersNegativeTestJSON-692949403 None] Deleted volume successfully. Apr 16 19:44:17 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c20c4e78-b5c9-46ff-90c8-c2c847e623c2 tempest-ServersNegativeTestJSON-692949403 None] Lock "cinder-65686cc3-4b80-40eb-9a4f-c37543b4e705-delete_volume" released by "delete_volume" :: held 2.142s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:44:18 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-285fa1cf-8586-4cc8-b992-290ab7537f10 tempest-ServersNegativeTestJSON-692949403 None] Acquiring lock "cinder-dc197412-8a11-4c40-b939-a5835867cf41-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:44:18 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-285fa1cf-8586-4cc8-b992-290ab7537f10 tempest-ServersNegativeTestJSON-692949403 None] Lock "cinder-dc197412-8a11-4c40-b939-a5835867cf41-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:44:18 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-285fa1cf-8586-4cc8-b992-290ab7537f10 tempest-ServersNegativeTestJSON-692949403 None] Acquiring lock "cinder-quobyte-dc197412-8a11-4c40-b939-a5835867cf41" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:44:18 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-285fa1cf-8586-4cc8-b992-290ab7537f10 tempest-ServersNegativeTestJSON-692949403 None] Lock "cinder-quobyte-dc197412-8a11-4c40-b939-a5835867cf41" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:44:18 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[16936aac-bf71-41c7-8634-2a4b035a75f3]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:44:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-285fa1cf-8586-4cc8-b992-290ab7537f10 tempest-ServersNegativeTestJSON-692949403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dc197412-8a11-4c40-b939-a5835867cf41 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:18 devstack sudo[86824]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3d02f98a-6bdb-4d7f-8ae7-96429a1695f5 tempest-GroupsTest-271104784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b473e43-f12c-4c43-aa31-413e7ce357e0" returned: 0 in 0.660s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:18 devstack sudo[86828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dc197412-8a11-4c40-b939-a5835867cf41 Apr 16 19:44:18 devstack sudo[86828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:18 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3d02f98a-6bdb-4d7f-8ae7-96429a1695f5 tempest-GroupsTest-271104784 None] Lock "cinder-quobyte-7b473e43-f12c-4c43-aa31-413e7ce357e0" released by "delete_volume" :: held 1.346s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:44:18 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-3d02f98a-6bdb-4d7f-8ae7-96429a1695f5 tempest-GroupsTest-271104784 None] Created reservations ['914318ab-bf52-428d-bce3-dacf94a408f5'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:44:18 devstack cinder-volume[82569]: WARNING cinder.quota [None req-3d02f98a-6bdb-4d7f-8ae7-96429a1695f5 tempest-GroupsTest-271104784 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-911248047 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-911248047, it is now deprecated. Please use the default quota class for default quota. Apr 16 19:44:18 devstack cinder-volume[82569]: WARNING cinder.quota [None req-3d02f98a-6bdb-4d7f-8ae7-96429a1695f5 tempest-GroupsTest-271104784 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-911248047 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-911248047, it is now deprecated. Please use the default quota class for default quota. Apr 16 19:44:18 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-3d02f98a-6bdb-4d7f-8ae7-96429a1695f5 tempest-GroupsTest-271104784 None] Created reservations ['fb171f7c-aeb1-4080-8623-8a59e0b611cb', '78b26d4f-fda8-4b23-862a-02c4248b377c', '9df917b1-0abd-45f4-b401-147559b48394', '1acbe0d9-0c02-44d9-a1fe-b44f3cf7de8a'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:44:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3d02f98a-6bdb-4d7f-8ae7-96429a1695f5 tempest-GroupsTest-271104784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3d02f98a-6bdb-4d7f-8ae7-96429a1695f5 tempest-GroupsTest-271104784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:18 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3d02f98a-6bdb-4d7f-8ae7-96429a1695f5 tempest-GroupsTest-271104784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:44:18 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3d02f98a-6bdb-4d7f-8ae7-96429a1695f5 tempest-GroupsTest-271104784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:44:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3d02f98a-6bdb-4d7f-8ae7-96429a1695f5 tempest-GroupsTest-271104784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3d02f98a-6bdb-4d7f-8ae7-96429a1695f5 tempest-GroupsTest-271104784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:18 devstack sudo[86830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:44:18 devstack sudo[86830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:19 devstack sudo[86828]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-285fa1cf-8586-4cc8-b992-290ab7537f10 tempest-ServersNegativeTestJSON-692949403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dc197412-8a11-4c40-b939-a5835867cf41" returned: 0 in 0.778s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-285fa1cf-8586-4cc8-b992-290ab7537f10 tempest-ServersNegativeTestJSON-692949403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dc197412-8a11-4c40-b939-a5835867cf41 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:19 devstack sudo[86835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dc197412-8a11-4c40-b939-a5835867cf41 Apr 16 19:44:19 devstack sudo[86835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:19 devstack sudo[86830]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3d02f98a-6bdb-4d7f-8ae7-96429a1695f5 tempest-GroupsTest-271104784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.625s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:19 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-3d02f98a-6bdb-4d7f-8ae7-96429a1695f5 tempest-GroupsTest-271104784 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:44:19 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-3d02f98a-6bdb-4d7f-8ae7-96429a1695f5 tempest-GroupsTest-271104784 None] Delete group completed successfully. Apr 16 19:44:19 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-28d81bd8-14ee-405a-bdf2-5f8cbf3846ae tempest-GroupsTest-271104784 None] Created reservations ['112e2242-29a8-4166-b9ba-e5d31175cd92'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:44:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-28d81bd8-14ee-405a-bdf2-5f8cbf3846ae tempest-GroupsTest-271104784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-28d81bd8-14ee-405a-bdf2-5f8cbf3846ae tempest-GroupsTest-271104784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:19 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-28d81bd8-14ee-405a-bdf2-5f8cbf3846ae tempest-GroupsTest-271104784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:44:19 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-28d81bd8-14ee-405a-bdf2-5f8cbf3846ae tempest-GroupsTest-271104784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:44:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-28d81bd8-14ee-405a-bdf2-5f8cbf3846ae tempest-GroupsTest-271104784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-28d81bd8-14ee-405a-bdf2-5f8cbf3846ae tempest-GroupsTest-271104784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:19 devstack sudo[86838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:44:19 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:19 devstack sudo[86835]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-285fa1cf-8586-4cc8-b992-290ab7537f10 tempest-ServersNegativeTestJSON-692949403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dc197412-8a11-4c40-b939-a5835867cf41" returned: 0 in 0.627s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:19 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-285fa1cf-8586-4cc8-b992-290ab7537f10 tempest-ServersNegativeTestJSON-692949403 None] Lock "cinder-quobyte-dc197412-8a11-4c40-b939-a5835867cf41" released by "delete_volume" :: held 1.436s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:44:19 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-285fa1cf-8586-4cc8-b992-290ab7537f10 tempest-ServersNegativeTestJSON-692949403 None] Created reservations ['6acf6dc3-6c88-4718-8684-68fe16e0c1dc', '5fb041ec-edd1-46cb-bfec-1ab2f1985758', '3f2364c8-b80e-4cef-be7b-ac67eea7a3d0', 'd20ee472-1a32-43bc-a993-808aa109a562'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:44:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-285fa1cf-8586-4cc8-b992-290ab7537f10 tempest-ServersNegativeTestJSON-692949403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-285fa1cf-8586-4cc8-b992-290ab7537f10 tempest-ServersNegativeTestJSON-692949403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:19 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-285fa1cf-8586-4cc8-b992-290ab7537f10 tempest-ServersNegativeTestJSON-692949403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:44:19 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-285fa1cf-8586-4cc8-b992-290ab7537f10 tempest-ServersNegativeTestJSON-692949403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:44:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-285fa1cf-8586-4cc8-b992-290ab7537f10 tempest-ServersNegativeTestJSON-692949403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-285fa1cf-8586-4cc8-b992-290ab7537f10 tempest-ServersNegativeTestJSON-692949403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:19 devstack sudo[86841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:44:19 devstack sudo[86841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:19 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-28d81bd8-14ee-405a-bdf2-5f8cbf3846ae tempest-GroupsTest-271104784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.488s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:19 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-28d81bd8-14ee-405a-bdf2-5f8cbf3846ae tempest-GroupsTest-271104784 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:44:19 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-28d81bd8-14ee-405a-bdf2-5f8cbf3846ae tempest-GroupsTest-271104784 None] Delete group completed successfully. Apr 16 19:44:20 devstack sudo[86841]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-285fa1cf-8586-4cc8-b992-290ab7537f10 tempest-ServersNegativeTestJSON-692949403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.492s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:20 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-285fa1cf-8586-4cc8-b992-290ab7537f10 tempest-ServersNegativeTestJSON-692949403 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:44:20 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-285fa1cf-8586-4cc8-b992-290ab7537f10 tempest-ServersNegativeTestJSON-692949403 None] Deleted volume successfully. Apr 16 19:44:20 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-285fa1cf-8586-4cc8-b992-290ab7537f10 tempest-ServersNegativeTestJSON-692949403 None] Lock "cinder-dc197412-8a11-4c40-b939-a5835867cf41-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:44:20 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-7bf4c39b-cc02-490a-b16b-781698af945d tempest-GroupsTest-271104784 None] Group tempest-GroupsTest-Group-1654070432: creating Apr 16 19:44:20 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-7bf4c39b-cc02-490a-b16b-781698af945d tempest-GroupsTest-271104784 None] Group tempest-GroupsTest-Group-1654070432: created successfully Apr 16 19:44:20 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-7bf4c39b-cc02-490a-b16b-781698af945d tempest-GroupsTest-271104784 None] Create group completed successfully. Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Flow 'volume_create_manager' (63e43a8c-675b-48ea-bb99-bb779a90f189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6661243f-8552-4f50-82b8-b94318d5202e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6661243f-8552-4f50-82b8-b94318d5202e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1120490376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3a2a6602-ef76-4515-815d-b45646870da1,host='devstack@QuobyteHD#QuobyteHD',id=2f095be3-a107-459a-b4b0-d06a3dadb253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee583c738e6f49cca49a557acc27f19c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:44:22Z,use_quota=True,user_id='d70a6bef996a4c0e9b8575481c2c0a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20f7ff89-64ad-4c2d-a770-35cbbda58b35),volume_type_id=20f7ff89-64ad-4c2d-a770-35cbbda58b35)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba0611b-8b90-4f85-ac80-6438d56a9d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba0611b-8b90-4f85-ac80-6438d56a9d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6496e5c3-9326-494d-bad8-00b7805e5b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6496e5c3-9326-494d-bad8-00b7805e5b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f095be3-a107-459a-b4b0-d06a3dadb253', 'volume_name': 'volume-2f095be3-a107-459a-b4b0-d06a3dadb253', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b813e2a-9fc8-4c1e-aab3-0eeb8364fada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b813e2a-9fc8-4c1e-aab3-0eeb8364fada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07414c1-ec06-4962-bf9c-a39d5c4f51e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:22 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Volume 2f095be3-a107-459a-b4b0-d06a3dadb253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f095be3-a107-459a-b4b0-d06a3dadb253', 'volume_size': 1} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3a2a6602-ef76-4515-815d-b45646870da1,created_at=2026-04-16T17:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1120490376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3a2a6602-ef76-4515-815d-b45646870da1,host='devstack@QuobyteHD#QuobyteHD',id=2f095be3-a107-459a-b4b0-d06a3dadb253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee583c738e6f49cca49a557acc27f19c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:44:22Z,use_quota=True,user_id='d70a6bef996a4c0e9b8575481c2c0a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20f7ff89-64ad-4c2d-a770-35cbbda58b35),volume_type_id=20f7ff89-64ad-4c2d-a770-35cbbda58b35)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Creating volume 2f095be3-a107-459a-b4b0-d06a3dadb253 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:44:22 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2f095be3-a107-459a-b4b0-d06a3dadb253 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:22 devstack sudo[86870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2f095be3-a107-459a-b4b0-d06a3dadb253 1073741824 Apr 16 19:44:22 devstack sudo[86870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Flow 'volume_create_manager' (357014e1-069a-4f0f-9605-7f3d0267de3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029de2e8-9cc5-4072-9dd4-1d7766103a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029de2e8-9cc5-4072-9dd4-1d7766103a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1184368621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0175689-4b8e-4898-b119-9cc1683b5679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cdfb5d12e4b4bfa99ba84f9e1e16ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:44:22Z,use_quota=True,user_id='5bc692a99f93451baa7b47b29a06466c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737dccd0-c20d-4131-a998-98d6e09be5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737dccd0-c20d-4131-a998-98d6e09be5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ec6f68-18e8-4ac9-b539-f91a3ee440d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ec6f68-18e8-4ac9-b539-f91a3ee440d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0175689-4b8e-4898-b119-9cc1683b5679', 'volume_name': 'volume-f0175689-4b8e-4898-b119-9cc1683b5679', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56bc206-6776-4b64-a7e2-98ab0862d5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56bc206-6776-4b64-a7e2-98ab0862d5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c003855-0bd1-4bd0-854e-ffed32760a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:22 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Volume f0175689-4b8e-4898-b119-9cc1683b5679: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0175689-4b8e-4898-b119-9cc1683b5679', 'volume_size': 1} Apr 16 19:44:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:23 devstack sudo[86870]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2f095be3-a107-459a-b4b0-d06a3dadb253 1073741824" returned: 0 in 0.663s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2f095be3-a107-459a-b4b0-d06a3dadb253 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:23 devstack sudo[86876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2f095be3-a107-459a-b4b0-d06a3dadb253 Apr 16 19:44:23 devstack sudo[86876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:23 devstack sudo[86876]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2f095be3-a107-459a-b4b0-d06a3dadb253" returned: 0 in 0.550s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:44:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.151s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1184368621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0175689-4b8e-4898-b119-9cc1683b5679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cdfb5d12e4b4bfa99ba84f9e1e16ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:44:22Z,use_quota=True,user_id='5bc692a99f93451baa7b47b29a06466c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:44:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Creating volume f0175689-4b8e-4898-b119-9cc1683b5679 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:44:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:44:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:44:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:44:23 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:44:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07414c1-ec06-4962-bf9c-a39d5c4f51e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f095be3-a107-459a-b4b0-d06a3dadb253', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c057557f-4fd3-4b4e-94ef-a47fa2a7580f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:23 devstack sudo[86882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679 1073741824 Apr 16 19:44:23 devstack sudo[86882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:23 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Volume volume-2f095be3-a107-459a-b4b0-d06a3dadb253 (2f095be3-a107-459a-b4b0-d06a3dadb253): created successfully Apr 16 19:44:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c057557f-4fd3-4b4e-94ef-a47fa2a7580f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Flow 'volume_create_manager' (63e43a8c-675b-48ea-bb99-bb779a90f189) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:44:23 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-f5867d49-bd62-4717-8b78-59cba35a1b78 tempest-GroupsTest-271104784 None] Created volume successfully. Apr 16 19:44:24 devstack sudo[86882]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679 1073741824" returned: 0 in 0.541s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:24 devstack sudo[86887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679 Apr 16 19:44:24 devstack sudo[86887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:24 devstack sudo[86887]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679" returned: 0 in 0.503s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c003855-0bd1-4bd0-854e-ffed32760a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0175689-4b8e-4898-b119-9cc1683b5679', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c4f96e2-321f-4ec5-8d7a-1c16ceea9a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:24 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Volume volume-f0175689-4b8e-4898-b119-9cc1683b5679 (f0175689-4b8e-4898-b119-9cc1683b5679): created successfully Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c4f96e2-321f-4ec5-8d7a-1c16ceea9a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Flow 'volume_create_manager' (357014e1-069a-4f0f-9605-7f3d0267de3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:44:24 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-eff8160c-24a7-419e-b773-f31c54e392c7 tempest-VolumesActionsTest-1728231658 None] Created volume successfully. Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Flow 'volume_create_manager' (e31c4d70-f7c3-4280-82e5-070794897e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (279117f0-05ec-44be-b319-e08da27722a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (279117f0-05ec-44be-b319-e08da27722a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-687723917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3a2a6602-ef76-4515-815d-b45646870da1,host='devstack@QuobyteHD#QuobyteHD',id=22332dc5-7c79-4519-b1aa-284da6c3afec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee583c738e6f49cca49a557acc27f19c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:44:25Z,use_quota=True,user_id='d70a6bef996a4c0e9b8575481c2c0a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20f7ff89-64ad-4c2d-a770-35cbbda58b35),volume_type_id=20f7ff89-64ad-4c2d-a770-35cbbda58b35)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeca253f-e7b0-493a-9988-4bb160a8bffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeca253f-e7b0-493a-9988-4bb160a8bffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc06e641-b959-4d91-a9ab-f0e3d84e83b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc06e641-b959-4d91-a9ab-f0e3d84e83b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22332dc5-7c79-4519-b1aa-284da6c3afec', 'volume_name': 'volume-22332dc5-7c79-4519-b1aa-284da6c3afec', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2ac3a3-779e-4c51-9f3d-da0be851fd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2ac3a3-779e-4c51-9f3d-da0be851fd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d32123b-22c6-4813-9e33-22f56bb4957b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:24 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Volume 22332dc5-7c79-4519-b1aa-284da6c3afec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22332dc5-7c79-4519-b1aa-284da6c3afec', 'volume_size': 1} Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3a2a6602-ef76-4515-815d-b45646870da1,created_at=2026-04-16T17:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-687723917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3a2a6602-ef76-4515-815d-b45646870da1,host='devstack@QuobyteHD#QuobyteHD',id=22332dc5-7c79-4519-b1aa-284da6c3afec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee583c738e6f49cca49a557acc27f19c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:44:25Z,use_quota=True,user_id='d70a6bef996a4c0e9b8575481c2c0a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20f7ff89-64ad-4c2d-a770-35cbbda58b35),volume_type_id=20f7ff89-64ad-4c2d-a770-35cbbda58b35)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Creating volume 22332dc5-7c79-4519-b1aa-284da6c3afec {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:44:24 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:44:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-22332dc5-7c79-4519-b1aa-284da6c3afec 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:24 devstack sudo[86890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-22332dc5-7c79-4519-b1aa-284da6c3afec 1073741824 Apr 16 19:44:24 devstack sudo[86890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:25 devstack sudo[86890]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-22332dc5-7c79-4519-b1aa-284da6c3afec 1073741824" returned: 0 in 0.555s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-22332dc5-7c79-4519-b1aa-284da6c3afec {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:25 devstack sudo[86895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-22332dc5-7c79-4519-b1aa-284da6c3afec Apr 16 19:44:25 devstack sudo[86895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:25 devstack sudo[86895]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-22332dc5-7c79-4519-b1aa-284da6c3afec" returned: 0 in 0.527s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:25 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:44:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d32123b-22c6-4813-9e33-22f56bb4957b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22332dc5-7c79-4519-b1aa-284da6c3afec', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc9606b-1ad9-479e-8319-25bd8bac499c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:26 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Volume volume-22332dc5-7c79-4519-b1aa-284da6c3afec (22332dc5-7c79-4519-b1aa-284da6c3afec): created successfully Apr 16 19:44:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc9606b-1ad9-479e-8319-25bd8bac499c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Flow 'volume_create_manager' (e31c4d70-f7c3-4280-82e5-070794897e37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:44:26 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-60fde221-241f-4025-bffe-6f396367d2c3 tempest-GroupsTest-271104784 None] Created volume successfully. Apr 16 19:44:27 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-1d45b877-835a-41d4-9c81-9d3f4c4a1c87 tempest-GroupsTest-271104784 None] Update group completed successfully. Apr 16 19:44:28 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-7561f38d-c562-45e4-b7d1-55c32218190b tempest-GroupsTest-271104784 None] Update group completed successfully. Apr 16 19:44:29 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] Acquiring lock "cinder-quobyte-22332dc5-7c79-4519-b1aa-284da6c3afec" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:44:29 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] Lock "cinder-quobyte-22332dc5-7c79-4519-b1aa-284da6c3afec" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:44:29 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[a638eba3-96b1-4473-8342-10e6159fb43e]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:44:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-22332dc5-7c79-4519-b1aa-284da6c3afec {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:29 devstack sudo[86903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-22332dc5-7c79-4519-b1aa-284da6c3afec Apr 16 19:44:29 devstack sudo[86903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:30 devstack sudo[86903]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-22332dc5-7c79-4519-b1aa-284da6c3afec" returned: 0 in 0.558s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-22332dc5-7c79-4519-b1aa-284da6c3afec {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:30 devstack sudo[86909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-22332dc5-7c79-4519-b1aa-284da6c3afec Apr 16 19:44:30 devstack sudo[86909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:30 devstack sudo[86909]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-22332dc5-7c79-4519-b1aa-284da6c3afec" returned: 0 in 0.577s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:30 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] Lock "cinder-quobyte-22332dc5-7c79-4519-b1aa-284da6c3afec" released by "delete_volume" :: held 1.217s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:44:30 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] Acquiring lock "cinder-quobyte-2f095be3-a107-459a-b4b0-d06a3dadb253" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:44:30 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] Lock "cinder-quobyte-2f095be3-a107-459a-b4b0-d06a3dadb253" acquired by "delete_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:44:30 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fbee5d-4532-4a51-9cbc-0aa47ffc4d7a]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:44:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2f095be3-a107-459a-b4b0-d06a3dadb253 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:31 devstack sudo[86912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2f095be3-a107-459a-b4b0-d06a3dadb253 Apr 16 19:44:31 devstack sudo[86912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:31 devstack sudo[86912]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2f095be3-a107-459a-b4b0-d06a3dadb253" returned: 0 in 0.606s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2f095be3-a107-459a-b4b0-d06a3dadb253 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:31 devstack sudo[86917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2f095be3-a107-459a-b4b0-d06a3dadb253 Apr 16 19:44:31 devstack sudo[86917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:32 devstack sudo[86917]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2f095be3-a107-459a-b4b0-d06a3dadb253" returned: 0 in 0.573s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:32 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] Lock "cinder-quobyte-2f095be3-a107-459a-b4b0-d06a3dadb253" released by "delete_volume" :: held 1.205s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:44:32 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] Created reservations ['a72f7d79-7967-4371-a822-6bcef30b7519'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:44:32 devstack cinder-volume[82569]: WARNING cinder.quota [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1097145145 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1097145145, it is now deprecated. Please use the default quota class for default quota. Apr 16 19:44:32 devstack cinder-volume[82569]: WARNING cinder.quota [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1097145145 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1097145145, it is now deprecated. Please use the default quota class for default quota. Apr 16 19:44:32 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] Created reservations ['2e6526b1-654d-413b-b4c3-07373ddc36aa', 'e800a8c3-cbee-452a-8736-ffaaf6d13d5b', '2275d3d0-1ac4-464b-933f-bee453fa1af0', 'c0745f61-a7ac-4f2e-a4ce-d98b238cb623'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:44:32 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] Created reservations ['f339e25e-5d24-4361-94a3-7c1a1ab077a8', '77094ae3-54b1-494d-8200-220be4654c9e', '0e4cbf2d-5c89-4b47-8c31-d1ce46614ef6', '1453f588-afda-4b38-b316-29bf6eaf1cf4'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:44:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:32 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:44:32 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:44:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:32 devstack sudo[86921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:44:32 devstack sudo[86921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:32 devstack sudo[86921]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.518s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:32 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:44:32 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-d15a06a4-2f8b-4a74-bc7d-0e6acb4e434a tempest-GroupsTest-271104784 None] Delete group completed successfully. Apr 16 19:44:33 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:44:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Flow 'volume_create_manager' (f4dd8446-04b6-45c1-8848-754ddfc26f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:44:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f7cbc22-7ec0-423f-bf74-7154c61710a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f7cbc22-7ec0-423f-bf74-7154c61710a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1402848540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7554604a-7c80-4039-92ed-cdbbe9800fb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52feabb6a85e4a5fb19461f8c74098a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:44:33Z,use_quota=True,user_id='cb390331ba804cbbba34f3464ab7730d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1fe0d59-ebb1-4a82-be43-ece410a7e511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1fe0d59-ebb1-4a82-be43-ece410a7e511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (851c2b8a-4f23-475a-9407-dd7aad20069b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (851c2b8a-4f23-475a-9407-dd7aad20069b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7554604a-7c80-4039-92ed-cdbbe9800fb4', 'volume_name': 'volume-7554604a-7c80-4039-92ed-cdbbe9800fb4', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9764be12-119c-42dd-be4d-b3ec4f48a7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9764be12-119c-42dd-be4d-b3ec4f48a7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed25de4-4d14-4187-8758-ac9bda1a416d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:33 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Volume 7554604a-7c80-4039-92ed-cdbbe9800fb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7554604a-7c80-4039-92ed-cdbbe9800fb4', 'volume_size': 1} Apr 16 19:44:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:33 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1402848540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7554604a-7c80-4039-92ed-cdbbe9800fb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52feabb6a85e4a5fb19461f8c74098a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:44:33Z,use_quota=True,user_id='cb390331ba804cbbba34f3464ab7730d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:44:33 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Creating volume 7554604a-7c80-4039-92ed-cdbbe9800fb4 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:44:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:33 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:44:33 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:44:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:33 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:44:33 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:44:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:33 devstack sudo[86940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4 1073741824 Apr 16 19:44:33 devstack sudo[86940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:34 devstack sudo[86940]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4 1073741824" returned: 0 in 0.574s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:34 devstack sudo[86945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4 Apr 16 19:44:34 devstack sudo[86945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:34 devstack sudo[86945]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4" returned: 0 in 0.558s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:44:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed25de4-4d14-4187-8758-ac9bda1a416d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7554604a-7c80-4039-92ed-cdbbe9800fb4', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d2a15b-7db7-43fa-857c-47b15184d0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:34 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Volume volume-7554604a-7c80-4039-92ed-cdbbe9800fb4 (7554604a-7c80-4039-92ed-cdbbe9800fb4): created successfully Apr 16 19:44:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d2a15b-7db7-43fa-857c-47b15184d0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Flow 'volume_create_manager' (f4dd8446-04b6-45c1-8848-754ddfc26f4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:44:34 devstack cinder-volume[82569]: INFO cinder.volume.manager [req-6da2d8b6-5a13-44e1-b4bf-82d6b2f9a122 req-e00c8b5e-4ca7-40b9-835e-3a7d04413450 tempest-VolumesSnapshotsTestJSON-2047503978 None] Created volume successfully. Apr 16 19:44:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-58b52c4e-1425-49b1-b062-c9f6415c7ca6 req-f2be88f3-5d1e-403e-b2c3-459bd2eeed1a tempest-VolumesSnapshotsTestJSON-2047503978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-58b52c4e-1425-49b1-b062-c9f6415c7ca6 req-f2be88f3-5d1e-403e-b2c3-459bd2eeed1a tempest-VolumesSnapshotsTestJSON-2047503978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:35 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [req-58b52c4e-1425-49b1-b062-c9f6415c7ca6 req-f2be88f3-5d1e-403e-b2c3-459bd2eeed1a tempest-VolumesSnapshotsTestJSON-2047503978 None] Creating offline snapshot 9173435e-88c9-421a-a69f-15296d6004b8 of volume 7554604a-7c80-4039-92ed-cdbbe9800fb4 {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:44:35 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[c074f3f5-70e3-4c94-8aac-ab8c920fef6b]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:44:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-58b52c4e-1425-49b1-b062-c9f6415c7ca6 req-f2be88f3-5d1e-403e-b2c3-459bd2eeed1a tempest-VolumesSnapshotsTestJSON-2047503978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:35 devstack sudo[86951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4 Apr 16 19:44:35 devstack sudo[86951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:36 devstack sudo[86951]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-58b52c4e-1425-49b1-b062-c9f6415c7ca6 req-f2be88f3-5d1e-403e-b2c3-459bd2eeed1a tempest-VolumesSnapshotsTestJSON-2047503978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4" returned: 0 in 0.550s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-58b52c4e-1425-49b1-b062-c9f6415c7ca6 req-f2be88f3-5d1e-403e-b2c3-459bd2eeed1a tempest-VolumesSnapshotsTestJSON-2047503978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4.9173435e-88c9-421a-a69f-15296d6004b8 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:36 devstack sudo[86956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4.9173435e-88c9-421a-a69f-15296d6004b8 1G Apr 16 19:44:36 devstack sudo[86956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:36 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:44:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Flow 'volume_create_manager' (35ca9ef2-932a-495e-9c6b-2ccf61cf18e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:44:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5288954d-0a8c-4cde-a95c-e2087fa060a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5288954d-0a8c-4cde-a95c-e2087fa060a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-532943335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84718657-a639-48d8-bf08-5aeb7fb16e97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='720e66c9279640858412cafd372476c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:44:37Z,use_quota=True,user_id='4d0096c311f5455786aeae7722cded8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d5be8c4-799f-4732-bf2d-a1f30eb0206b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d5be8c4-799f-4732-bf2d-a1f30eb0206b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7567309b-a5ed-42ef-b17f-f58b06b5bd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7567309b-a5ed-42ef-b17f-f58b06b5bd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84718657-a639-48d8-bf08-5aeb7fb16e97', 'volume_name': 'volume-84718657-a639-48d8-bf08-5aeb7fb16e97', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677eb09f-39a6-4274-bc8d-517f0de17c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677eb09f-39a6-4274-bc8d-517f0de17c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec96188-03fd-4cd8-ad6b-f1eb10870ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:36 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Volume 84718657-a639-48d8-bf08-5aeb7fb16e97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84718657-a639-48d8-bf08-5aeb7fb16e97', 'volume_size': 1} Apr 16 19:44:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:37 devstack sudo[86956]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-58b52c4e-1425-49b1-b062-c9f6415c7ca6 req-f2be88f3-5d1e-403e-b2c3-459bd2eeed1a tempest-VolumesSnapshotsTestJSON-2047503978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4.9173435e-88c9-421a-a69f-15296d6004b8 1G" returned: 0 in 0.683s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-58b52c4e-1425-49b1-b062-c9f6415c7ca6 req-f2be88f3-5d1e-403e-b2c3-459bd2eeed1a tempest-VolumesSnapshotsTestJSON-2047503978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7554604a-7c80-4039-92ed-cdbbe9800fb4 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4.9173435e-88c9-421a-a69f-15296d6004b8 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:37 devstack sudo[86987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7554604a-7c80-4039-92ed-cdbbe9800fb4 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4.9173435e-88c9-421a-a69f-15296d6004b8 Apr 16 19:44:37 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:37 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-58b52c4e-1425-49b1-b062-c9f6415c7ca6 req-f2be88f3-5d1e-403e-b2c3-459bd2eeed1a tempest-VolumesSnapshotsTestJSON-2047503978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7554604a-7c80-4039-92ed-cdbbe9800fb4 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4.9173435e-88c9-421a-a69f-15296d6004b8" returned: 0 in 0.546s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:37 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [req-58b52c4e-1425-49b1-b062-c9f6415c7ca6 req-f2be88f3-5d1e-403e-b2c3-459bd2eeed1a tempest-VolumesSnapshotsTestJSON-2047503978 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4.9173435e-88c9-421a-a69f-15296d6004b8 is being set with open permissions: ugo+rw Apr 16 19:44:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-58b52c4e-1425-49b1-b062-c9f6415c7ca6 req-f2be88f3-5d1e-403e-b2c3-459bd2eeed1a tempest-VolumesSnapshotsTestJSON-2047503978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4.9173435e-88c9-421a-a69f-15296d6004b8 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:37 devstack sudo[86994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4.9173435e-88c9-421a-a69f-15296d6004b8 Apr 16 19:44:37 devstack sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:38 devstack sudo[86994]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-58b52c4e-1425-49b1-b062-c9f6415c7ca6 req-f2be88f3-5d1e-403e-b2c3-459bd2eeed1a tempest-VolumesSnapshotsTestJSON-2047503978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4.9173435e-88c9-421a-a69f-15296d6004b8" returned: 0 in 0.523s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-58b52c4e-1425-49b1-b062-c9f6415c7ca6 req-f2be88f3-5d1e-403e-b2c3-459bd2eeed1a tempest-VolumesSnapshotsTestJSON-2047503978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:38 devstack sudo[86997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4.info Apr 16 19:44:38 devstack sudo[86997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:38 devstack sudo[86997]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-58b52c4e-1425-49b1-b062-c9f6415c7ca6 req-f2be88f3-5d1e-403e-b2c3-459bd2eeed1a tempest-VolumesSnapshotsTestJSON-2047503978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4.info" returned: 0 in 0.489s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:38 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [req-58b52c4e-1425-49b1-b062-c9f6415c7ca6 req-f2be88f3-5d1e-403e-b2c3-459bd2eeed1a tempest-VolumesSnapshotsTestJSON-2047503978 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4.info is being set with open permissions: ugo+rw Apr 16 19:44:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-58b52c4e-1425-49b1-b062-c9f6415c7ca6 req-f2be88f3-5d1e-403e-b2c3-459bd2eeed1a tempest-VolumesSnapshotsTestJSON-2047503978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:38 devstack sudo[87000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4.info Apr 16 19:44:38 devstack sudo[87000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:39 devstack sudo[87000]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-58b52c4e-1425-49b1-b062-c9f6415c7ca6 req-f2be88f3-5d1e-403e-b2c3-459bd2eeed1a tempest-VolumesSnapshotsTestJSON-2047503978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4.info" returned: 0 in 0.478s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-58b52c4e-1425-49b1-b062-c9f6415c7ca6 req-f2be88f3-5d1e-403e-b2c3-459bd2eeed1a tempest-VolumesSnapshotsTestJSON-2047503978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.351s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.388s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-532943335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84718657-a639-48d8-bf08-5aeb7fb16e97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='720e66c9279640858412cafd372476c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:44:37Z,use_quota=True,user_id='4d0096c311f5455786aeae7722cded8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Creating volume 84718657-a639-48d8-bf08-5aeb7fb16e97 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:44:39 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-84718657-a639-48d8-bf08-5aeb7fb16e97 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:39 devstack sudo[87003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-84718657-a639-48d8-bf08-5aeb7fb16e97 1073741824 Apr 16 19:44:39 devstack sudo[87003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:39 devstack cinder-volume[82569]: INFO cinder.volume.manager [req-58b52c4e-1425-49b1-b062-c9f6415c7ca6 req-f2be88f3-5d1e-403e-b2c3-459bd2eeed1a tempest-VolumesSnapshotsTestJSON-2047503978 None] Create snapshot completed successfully Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0766ca0c-4b42-4053-ab8f-8cdc0ed0ef83 tempest-VolumesActionsTest-1728231658 None] Acquiring lock "cinder-f0175689-4b8e-4898-b119-9cc1683b5679" by "attach_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0766ca0c-4b42-4053-ab8f-8cdc0ed0ef83 tempest-VolumesActionsTest-1728231658 None] Lock "cinder-f0175689-4b8e-4898-b119-9cc1683b5679" acquired by "attach_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:44:39 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-0766ca0c-4b42-4053-ab8f-8cdc0ed0ef83 tempest-VolumesActionsTest-1728231658 None] Attaching volume f0175689-4b8e-4898-b119-9cc1683b5679 to instance f18db4dd-7654-43b5-a64e-973882557865 at mountpoint /dev/vdb on host None. Apr 16 19:44:39 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-0766ca0c-4b42-4053-ab8f-8cdc0ed0ef83 tempest-VolumesActionsTest-1728231658 None] Attach volume completed successfully. Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-d4747834-cdd1-481a-a401-a4316b64c0c9 req-44b379ff-6ca6-4ce9-b445-3ca7d2625277 tempest-VolumesSnapshotsTestJSON-2047503978 None] Acquiring lock "cinder-9173435e-88c9-421a-a69f-15296d6004b8-delete_snapshot" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0766ca0c-4b42-4053-ab8f-8cdc0ed0ef83 tempest-VolumesActionsTest-1728231658 None] Lock "cinder-f0175689-4b8e-4898-b119-9cc1683b5679" released by "attach_volume" :: held 0.109s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-d4747834-cdd1-481a-a401-a4316b64c0c9 req-44b379ff-6ca6-4ce9-b445-3ca7d2625277 tempest-VolumesSnapshotsTestJSON-2047503978 None] Lock "cinder-9173435e-88c9-421a-a69f-15296d6004b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-d4747834-cdd1-481a-a401-a4316b64c0c9 req-44b379ff-6ca6-4ce9-b445-3ca7d2625277 tempest-VolumesSnapshotsTestJSON-2047503978 None] Acquiring lock "cinder-quobyte-7554604a-7c80-4039-92ed-cdbbe9800fb4" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-d4747834-cdd1-481a-a401-a4316b64c0c9 req-44b379ff-6ca6-4ce9-b445-3ca7d2625277 tempest-VolumesSnapshotsTestJSON-2047503978 None] Lock "cinder-quobyte-7554604a-7c80-4039-92ed-cdbbe9800fb4" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-d4747834-cdd1-481a-a401-a4316b64c0c9 req-44b379ff-6ca6-4ce9-b445-3ca7d2625277 tempest-VolumesSnapshotsTestJSON-2047503978 None] Acquiring lock "cinder-quobyte-9173435e-88c9-421a-a69f-15296d6004b8" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-d4747834-cdd1-481a-a401-a4316b64c0c9 req-44b379ff-6ca6-4ce9-b445-3ca7d2625277 tempest-VolumesSnapshotsTestJSON-2047503978 None] Lock "cinder-quobyte-9173435e-88c9-421a-a69f-15296d6004b8" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [req-d4747834-cdd1-481a-a401-a4316b64c0c9 req-44b379ff-6ca6-4ce9-b445-3ca7d2625277 tempest-VolumesSnapshotsTestJSON-2047503978 None] Deleting offline snapshot 9173435e-88c9-421a-a69f-15296d6004b8 of volume 7554604a-7c80-4039-92ed-cdbbe9800fb4 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [req-d4747834-cdd1-481a-a401-a4316b64c0c9 req-44b379ff-6ca6-4ce9-b445-3ca7d2625277 tempest-VolumesSnapshotsTestJSON-2047503978 None] snapshot_file for this snap is: volume-7554604a-7c80-4039-92ed-cdbbe9800fb4.9173435e-88c9-421a-a69f-15296d6004b8 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b123a2-eecd-441f-823b-f214a8353286]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-d4747834-cdd1-481a-a401-a4316b64c0c9 req-44b379ff-6ca6-4ce9-b445-3ca7d2625277 tempest-VolumesSnapshotsTestJSON-2047503978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4.9173435e-88c9-421a-a69f-15296d6004b8 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:39 devstack sudo[87005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4.9173435e-88c9-421a-a69f-15296d6004b8 Apr 16 19:44:39 devstack sudo[87005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:39 devstack sudo[87003]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-677e9d2f-f82f-457b-acd4-7ba220de9734 tempest-VolumesActionsTest-1728231658 None] Acquiring lock "cinder-f0175689-4b8e-4898-b119-9cc1683b5679-detach_volume" by "detach_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-84718657-a639-48d8-bf08-5aeb7fb16e97 1073741824" returned: 0 in 0.685s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-677e9d2f-f82f-457b-acd4-7ba220de9734 tempest-VolumesActionsTest-1728231658 None] Lock "cinder-f0175689-4b8e-4898-b119-9cc1683b5679-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:44:39 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-677e9d2f-f82f-457b-acd4-7ba220de9734 tempest-VolumesActionsTest-1728231658 None] Detaching volume f0175689-4b8e-4898-b119-9cc1683b5679 from instance f18db4dd-7654-43b5-a64e-973882557865. Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-84718657-a639-48d8-bf08-5aeb7fb16e97 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:39 devstack sudo[87012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-84718657-a639-48d8-bf08-5aeb7fb16e97 Apr 16 19:44:39 devstack sudo[87012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:39 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-677e9d2f-f82f-457b-acd4-7ba220de9734 tempest-VolumesActionsTest-1728231658 None] Detach volume completed successfully. Apr 16 19:44:39 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-677e9d2f-f82f-457b-acd4-7ba220de9734 tempest-VolumesActionsTest-1728231658 None] Lock "cinder-f0175689-4b8e-4898-b119-9cc1683b5679-detach_volume" released by "detach_volume" :: held 0.097s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:44:40 devstack sudo[87005]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-d4747834-cdd1-481a-a401-a4316b64c0c9 req-44b379ff-6ca6-4ce9-b445-3ca7d2625277 tempest-VolumesSnapshotsTestJSON-2047503978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4.9173435e-88c9-421a-a69f-15296d6004b8" returned: 0 in 0.632s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [req-d4747834-cdd1-481a-a401-a4316b64c0c9 req-44b379ff-6ca6-4ce9-b445-3ca7d2625277 tempest-VolumesSnapshotsTestJSON-2047503978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7554604a-7c80-4039-92ed-cdbbe9800fb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:44:40 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b7cec3-91c6-4462-bbbe-31c72b1ef763]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:44:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-d4747834-cdd1-481a-a401-a4316b64c0c9 req-44b379ff-6ca6-4ce9-b445-3ca7d2625277 tempest-VolumesSnapshotsTestJSON-2047503978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:40 devstack sudo[87015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4 Apr 16 19:44:40 devstack sudo[87015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:40 devstack sudo[87012]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-84718657-a639-48d8-bf08-5aeb7fb16e97" returned: 0 in 0.431s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:44:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec96188-03fd-4cd8-ad6b-f1eb10870ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84718657-a639-48d8-bf08-5aeb7fb16e97', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f952e9-007d-4cbe-8f65-1089ca902d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:40 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Volume volume-84718657-a639-48d8-bf08-5aeb7fb16e97 (84718657-a639-48d8-bf08-5aeb7fb16e97): created successfully Apr 16 19:44:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f952e9-007d-4cbe-8f65-1089ca902d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Flow 'volume_create_manager' (35ca9ef2-932a-495e-9c6b-2ccf61cf18e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:44:40 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-50396130-87fd-4ed9-b978-6257b6d14b7a tempest-VolumeQuotasNegativeTestJSON-334140705 None] Created volume successfully. Apr 16 19:44:40 devstack sudo[87015]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-d4747834-cdd1-481a-a401-a4316b64c0c9 req-44b379ff-6ca6-4ce9-b445-3ca7d2625277 tempest-VolumesSnapshotsTestJSON-2047503978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4" returned: 0 in 0.617s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-d4747834-cdd1-481a-a401-a4316b64c0c9 req-44b379ff-6ca6-4ce9-b445-3ca7d2625277 tempest-VolumesSnapshotsTestJSON-2047503978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4.9173435e-88c9-421a-a69f-15296d6004b8 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:40 devstack sudo[87022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4.9173435e-88c9-421a-a69f-15296d6004b8 Apr 16 19:44:40 devstack sudo[87022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:41 devstack sudo[87022]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-d4747834-cdd1-481a-a401-a4316b64c0c9 req-44b379ff-6ca6-4ce9-b445-3ca7d2625277 tempest-VolumesSnapshotsTestJSON-2047503978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4.9173435e-88c9-421a-a69f-15296d6004b8" returned: 0 in 0.793s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-d4747834-cdd1-481a-a401-a4316b64c0c9 req-44b379ff-6ca6-4ce9-b445-3ca7d2625277 tempest-VolumesSnapshotsTestJSON-2047503978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4.9173435e-88c9-421a-a69f-15296d6004b8 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:41 devstack sudo[87054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4.9173435e-88c9-421a-a69f-15296d6004b8 Apr 16 19:44:41 devstack sudo[87054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:41 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b332c24a-563d-4fcc-959c-458d9719796c tempest-VolumeQuotasNegativeTestJSON-334140705 None] Acquiring lock "cinder-84718657-a639-48d8-bf08-5aeb7fb16e97-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:44:41 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b332c24a-563d-4fcc-959c-458d9719796c tempest-VolumeQuotasNegativeTestJSON-334140705 None] Lock "cinder-84718657-a639-48d8-bf08-5aeb7fb16e97-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:44:41 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b332c24a-563d-4fcc-959c-458d9719796c tempest-VolumeQuotasNegativeTestJSON-334140705 None] Acquiring lock "cinder-quobyte-84718657-a639-48d8-bf08-5aeb7fb16e97" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:44:41 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b332c24a-563d-4fcc-959c-458d9719796c tempest-VolumeQuotasNegativeTestJSON-334140705 None] Lock "cinder-quobyte-84718657-a639-48d8-bf08-5aeb7fb16e97" acquired by "delete_volume" :: waited 0.016s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:44:41 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d163e03-c633-4011-ac6c-3d24d06d33b9]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:44:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b332c24a-563d-4fcc-959c-458d9719796c tempest-VolumeQuotasNegativeTestJSON-334140705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-84718657-a639-48d8-bf08-5aeb7fb16e97 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:42 devstack sudo[87054]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-d4747834-cdd1-481a-a401-a4316b64c0c9 req-44b379ff-6ca6-4ce9-b445-3ca7d2625277 tempest-VolumesSnapshotsTestJSON-2047503978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4.9173435e-88c9-421a-a69f-15296d6004b8" returned: 0 in 0.572s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:42 devstack sudo[87058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-84718657-a639-48d8-bf08-5aeb7fb16e97 Apr 16 19:44:42 devstack sudo[87058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:42 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-d4747834-cdd1-481a-a401-a4316b64c0c9 req-44b379ff-6ca6-4ce9-b445-3ca7d2625277 tempest-VolumesSnapshotsTestJSON-2047503978 None] Lock "cinder-quobyte-9173435e-88c9-421a-a69f-15296d6004b8" released by "_delete_snapshot" :: held 2.694s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:44:42 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-d4747834-cdd1-481a-a401-a4316b64c0c9 req-44b379ff-6ca6-4ce9-b445-3ca7d2625277 tempest-VolumesSnapshotsTestJSON-2047503978 None] Lock "cinder-quobyte-7554604a-7c80-4039-92ed-cdbbe9800fb4" released by "delete_snapshot" :: held 2.712s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:44:42 devstack cinder-volume[82569]: DEBUG cinder.quota [req-d4747834-cdd1-481a-a401-a4316b64c0c9 req-44b379ff-6ca6-4ce9-b445-3ca7d2625277 tempest-VolumesSnapshotsTestJSON-2047503978 None] Created reservations ['34b9f7d8-cd51-433d-ba4a-a7374770b3ae', '1c024c97-e867-4641-8b5b-2ae91195e2cf', 'bb01a132-d0c0-4646-893a-6b51e3c38c54', 'e5790c67-bc56-41cf-a5b2-465f11a9e264'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:44:42 devstack cinder-volume[82569]: INFO cinder.volume.manager [req-d4747834-cdd1-481a-a401-a4316b64c0c9 req-44b379ff-6ca6-4ce9-b445-3ca7d2625277 tempest-VolumesSnapshotsTestJSON-2047503978 None] Delete snapshot completed successfully. Apr 16 19:44:42 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-d4747834-cdd1-481a-a401-a4316b64c0c9 req-44b379ff-6ca6-4ce9-b445-3ca7d2625277 tempest-VolumesSnapshotsTestJSON-2047503978 None] Lock "cinder-9173435e-88c9-421a-a69f-15296d6004b8-delete_snapshot" released by "delete_snapshot" :: held 2.850s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:44:42 devstack sudo[87058]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b332c24a-563d-4fcc-959c-458d9719796c tempest-VolumeQuotasNegativeTestJSON-334140705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-84718657-a639-48d8-bf08-5aeb7fb16e97" returned: 0 in 0.548s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b332c24a-563d-4fcc-959c-458d9719796c tempest-VolumeQuotasNegativeTestJSON-334140705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-84718657-a639-48d8-bf08-5aeb7fb16e97 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:42 devstack sudo[87064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-84718657-a639-48d8-bf08-5aeb7fb16e97 Apr 16 19:44:42 devstack sudo[87064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:42 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-5a1fd8e7-dff5-4b0b-850c-301e707b8b48 req-85bbc3b1-18e7-402a-b9d5-70f2190de2bc tempest-VolumesSnapshotsTestJSON-2047503978 None] Acquiring lock "cinder-7554604a-7c80-4039-92ed-cdbbe9800fb4-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:44:42 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-5a1fd8e7-dff5-4b0b-850c-301e707b8b48 req-85bbc3b1-18e7-402a-b9d5-70f2190de2bc tempest-VolumesSnapshotsTestJSON-2047503978 None] Lock "cinder-7554604a-7c80-4039-92ed-cdbbe9800fb4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:44:42 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-5a1fd8e7-dff5-4b0b-850c-301e707b8b48 req-85bbc3b1-18e7-402a-b9d5-70f2190de2bc tempest-VolumesSnapshotsTestJSON-2047503978 None] Acquiring lock "cinder-quobyte-7554604a-7c80-4039-92ed-cdbbe9800fb4" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:44:42 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-5a1fd8e7-dff5-4b0b-850c-301e707b8b48 req-85bbc3b1-18e7-402a-b9d5-70f2190de2bc tempest-VolumesSnapshotsTestJSON-2047503978 None] Lock "cinder-quobyte-7554604a-7c80-4039-92ed-cdbbe9800fb4" acquired by "delete_volume" :: waited 0.013s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:44:42 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1232e93-7fc2-436b-bb02-ced2841142eb]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:44:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-5a1fd8e7-dff5-4b0b-850c-301e707b8b48 req-85bbc3b1-18e7-402a-b9d5-70f2190de2bc tempest-VolumesSnapshotsTestJSON-2047503978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:42 devstack sudo[87067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4 Apr 16 19:44:42 devstack sudo[87067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:43 devstack sudo[87064]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b332c24a-563d-4fcc-959c-458d9719796c tempest-VolumeQuotasNegativeTestJSON-334140705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-84718657-a639-48d8-bf08-5aeb7fb16e97" returned: 0 in 0.581s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b332c24a-563d-4fcc-959c-458d9719796c tempest-VolumeQuotasNegativeTestJSON-334140705 None] Lock "cinder-quobyte-84718657-a639-48d8-bf08-5aeb7fb16e97" released by "delete_volume" :: held 1.172s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:44:43 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-b332c24a-563d-4fcc-959c-458d9719796c tempest-VolumeQuotasNegativeTestJSON-334140705 None] Created reservations ['59fef8d4-a413-4f7c-a9a2-3b94c9677c0a', 'b2055938-a845-4ed9-a364-812524081d40', '48243562-8a49-4f41-9eb2-923193ad672c', '44a10289-a026-4073-975b-359997612ebb'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:44:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b332c24a-563d-4fcc-959c-458d9719796c tempest-VolumeQuotasNegativeTestJSON-334140705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b332c24a-563d-4fcc-959c-458d9719796c tempest-VolumeQuotasNegativeTestJSON-334140705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:43 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-b332c24a-563d-4fcc-959c-458d9719796c tempest-VolumeQuotasNegativeTestJSON-334140705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:44:43 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-b332c24a-563d-4fcc-959c-458d9719796c tempest-VolumeQuotasNegativeTestJSON-334140705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:44:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b332c24a-563d-4fcc-959c-458d9719796c tempest-VolumeQuotasNegativeTestJSON-334140705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b332c24a-563d-4fcc-959c-458d9719796c tempest-VolumeQuotasNegativeTestJSON-334140705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:43 devstack sudo[87071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:44:43 devstack sudo[87071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:43 devstack sudo[87067]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-5a1fd8e7-dff5-4b0b-850c-301e707b8b48 req-85bbc3b1-18e7-402a-b9d5-70f2190de2bc tempest-VolumesSnapshotsTestJSON-2047503978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4" returned: 0 in 0.600s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-5a1fd8e7-dff5-4b0b-850c-301e707b8b48 req-85bbc3b1-18e7-402a-b9d5-70f2190de2bc tempest-VolumesSnapshotsTestJSON-2047503978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:43 devstack sudo[87077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4 Apr 16 19:44:43 devstack sudo[87077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:43 devstack sudo[87071]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b332c24a-563d-4fcc-959c-458d9719796c tempest-VolumeQuotasNegativeTestJSON-334140705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.444s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:43 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-b332c24a-563d-4fcc-959c-458d9719796c tempest-VolumeQuotasNegativeTestJSON-334140705 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:44:43 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-b332c24a-563d-4fcc-959c-458d9719796c tempest-VolumeQuotasNegativeTestJSON-334140705 None] Deleted volume successfully. Apr 16 19:44:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b332c24a-563d-4fcc-959c-458d9719796c tempest-VolumeQuotasNegativeTestJSON-334140705 None] Lock "cinder-84718657-a639-48d8-bf08-5aeb7fb16e97-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:44:43 devstack sudo[87077]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-5a1fd8e7-dff5-4b0b-850c-301e707b8b48 req-85bbc3b1-18e7-402a-b9d5-70f2190de2bc tempest-VolumesSnapshotsTestJSON-2047503978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7554604a-7c80-4039-92ed-cdbbe9800fb4" returned: 0 in 0.443s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-5a1fd8e7-dff5-4b0b-850c-301e707b8b48 req-85bbc3b1-18e7-402a-b9d5-70f2190de2bc tempest-VolumesSnapshotsTestJSON-2047503978 None] Lock "cinder-quobyte-7554604a-7c80-4039-92ed-cdbbe9800fb4" released by "delete_volume" :: held 1.084s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:44:43 devstack cinder-volume[82569]: DEBUG cinder.quota [req-5a1fd8e7-dff5-4b0b-850c-301e707b8b48 req-85bbc3b1-18e7-402a-b9d5-70f2190de2bc tempest-VolumesSnapshotsTestJSON-2047503978 None] Created reservations ['072a35da-c42d-476f-9f60-45867c2d160f', '96fcaa1c-26d5-490f-94d9-8ecac44cb69b', 'efecf6d5-2638-4499-9b36-9e28be842fa9', 'fc895479-f89b-4860-93bc-c9644e25c6a0'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:44:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-5a1fd8e7-dff5-4b0b-850c-301e707b8b48 req-85bbc3b1-18e7-402a-b9d5-70f2190de2bc tempest-VolumesSnapshotsTestJSON-2047503978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-5a1fd8e7-dff5-4b0b-850c-301e707b8b48 req-85bbc3b1-18e7-402a-b9d5-70f2190de2bc tempest-VolumesSnapshotsTestJSON-2047503978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:43 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-5a1fd8e7-dff5-4b0b-850c-301e707b8b48 req-85bbc3b1-18e7-402a-b9d5-70f2190de2bc tempest-VolumesSnapshotsTestJSON-2047503978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:44:43 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [req-5a1fd8e7-dff5-4b0b-850c-301e707b8b48 req-85bbc3b1-18e7-402a-b9d5-70f2190de2bc tempest-VolumesSnapshotsTestJSON-2047503978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:44:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [req-5a1fd8e7-dff5-4b0b-850c-301e707b8b48 req-85bbc3b1-18e7-402a-b9d5-70f2190de2bc tempest-VolumesSnapshotsTestJSON-2047503978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-5a1fd8e7-dff5-4b0b-850c-301e707b8b48 req-85bbc3b1-18e7-402a-b9d5-70f2190de2bc tempest-VolumesSnapshotsTestJSON-2047503978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:44 devstack sudo[87081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:44:44 devstack sudo[87081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:44 devstack sudo[87081]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [req-5a1fd8e7-dff5-4b0b-850c-301e707b8b48 req-85bbc3b1-18e7-402a-b9d5-70f2190de2bc tempest-VolumesSnapshotsTestJSON-2047503978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.653s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:44 devstack cinder-volume[82569]: DEBUG cinder.manager [req-5a1fd8e7-dff5-4b0b-850c-301e707b8b48 req-85bbc3b1-18e7-402a-b9d5-70f2190de2bc tempest-VolumesSnapshotsTestJSON-2047503978 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:44:44 devstack cinder-volume[82569]: INFO cinder.volume.manager [req-5a1fd8e7-dff5-4b0b-850c-301e707b8b48 req-85bbc3b1-18e7-402a-b9d5-70f2190de2bc tempest-VolumesSnapshotsTestJSON-2047503978 None] Deleted volume successfully. Apr 16 19:44:44 devstack cinder-volume[82569]: DEBUG dbcounter [-] [82569] Writing DB stats cinder:SELECT=158,cinder:UPDATE=184,cinder:DELETE=10,cinder:INSERT=46 {{(pid=82569) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:44:44 devstack cinder-volume[82569]: DEBUG cinder.coordination [req-5a1fd8e7-dff5-4b0b-850c-301e707b8b48 req-85bbc3b1-18e7-402a-b9d5-70f2190de2bc tempest-VolumesSnapshotsTestJSON-2047503978 None] Lock "cinder-7554604a-7c80-4039-92ed-cdbbe9800fb4-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:44:51 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-2e714a24-e83e-47a7-84d0-2ea7241b4c70 tempest-GroupsV314Test-32920575 None] Group tempest-GroupsV314Test-Group-294417259: creating Apr 16 19:44:51 devstack cinder-volume[82569]: DEBUG dbcounter [-] [82569] Writing DB stats cinder:SELECT=170,cinder:INSERT=49,cinder:UPDATE=209,cinder:DELETE=13 {{(pid=82569) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:44:51 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-2e714a24-e83e-47a7-84d0-2ea7241b4c70 tempest-GroupsV314Test-32920575 None] Group tempest-GroupsV314Test-Group-294417259: created successfully Apr 16 19:44:51 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-2e714a24-e83e-47a7-84d0-2ea7241b4c70 tempest-GroupsV314Test-32920575 None] Create group completed successfully. Apr 16 19:44:53 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:44:53 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Flow 'volume_create_manager' (12afb835-d329-4474-aa0f-96dcba8a9bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:44:53 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b87e828-1e3c-4ba3-9673-aa94ebf4a5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:53 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b87e828-1e3c-4ba3-9673-aa94ebf4a5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1575386037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6022ff4e-8d55-4d76-83f2-bf431e6afd21,host='devstack@QuobyteHD#QuobyteHD',id=7b317236-82a5-42c4-ac54-d12cdca3dd77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f30e858efa343ecb4a9024386b6c73d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:44:53Z,use_quota=True,user_id='6e23c0c474514bb38b51c08dc4c7d8b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(616c8541-c155-48ed-99a3-c4dba9f0fbe3),volume_type_id=616c8541-c155-48ed-99a3-c4dba9f0fbe3)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:53 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b34a15-8e66-4b80-a838-8c0603450f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:53 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b34a15-8e66-4b80-a838-8c0603450f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:53 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90be271b-5122-4e9c-b65c-7545d411c765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:53 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90be271b-5122-4e9c-b65c-7545d411c765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b317236-82a5-42c4-ac54-d12cdca3dd77', 'volume_name': 'volume-7b317236-82a5-42c4-ac54-d12cdca3dd77', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:53 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbdbd599-f3cc-4c08-bb34-a076702f1592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:53 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbdbd599-f3cc-4c08-bb34-a076702f1592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:53 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4497452c-9cd0-4e27-bff4-57fa84d141dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:53 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Volume 7b317236-82a5-42c4-ac54-d12cdca3dd77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b317236-82a5-42c4-ac54-d12cdca3dd77', 'volume_size': 1} Apr 16 19:44:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:53 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6022ff4e-8d55-4d76-83f2-bf431e6afd21,created_at=2026-04-16T17:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1575386037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6022ff4e-8d55-4d76-83f2-bf431e6afd21,host='devstack@QuobyteHD#QuobyteHD',id=7b317236-82a5-42c4-ac54-d12cdca3dd77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f30e858efa343ecb4a9024386b6c73d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:44:53Z,use_quota=True,user_id='6e23c0c474514bb38b51c08dc4c7d8b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(616c8541-c155-48ed-99a3-c4dba9f0fbe3),volume_type_id=616c8541-c155-48ed-99a3-c4dba9f0fbe3)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:44:53 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Creating volume 7b317236-82a5-42c4-ac54-d12cdca3dd77 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:44:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:53 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:44:53 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:44:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:53 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:44:53 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:44:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:53 devstack sudo[87095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77 1073741824 Apr 16 19:44:53 devstack sudo[87095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:53 devstack sudo[87095]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77 1073741824" returned: 0 in 0.652s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:54 devstack sudo[87101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77 Apr 16 19:44:54 devstack sudo[87101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:54 devstack sudo[87101]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77" returned: 0 in 0.543s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:54 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:44:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4497452c-9cd0-4e27-bff4-57fa84d141dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b317236-82a5-42c4-ac54-d12cdca3dd77', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4384afd-aa11-4a97-8c2f-7c89ae871245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:44:54 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Volume volume-7b317236-82a5-42c4-ac54-d12cdca3dd77 (7b317236-82a5-42c4-ac54-d12cdca3dd77): created successfully Apr 16 19:44:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4384afd-aa11-4a97-8c2f-7c89ae871245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:44:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Flow 'volume_create_manager' (12afb835-d329-4474-aa0f-96dcba8a9bbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:44:54 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-1e011fc8-3a4d-4136-9a8c-99a3b9671c2c tempest-GroupsV314Test-32920575 None] Created volume successfully. Apr 16 19:44:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:56 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Cloning volume 7b317236-82a5-42c4-ac54-d12cdca3dd77 to volume eb15e5ee-2f70-4893-ab0a-ea3ef889a20b Apr 16 19:44:56 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Creating offline snapshot 8fdd6d68-b66d-4e30-b8cd-93b69c56c347 of volume 7b317236-82a5-42c4-ac54-d12cdca3dd77 {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:44:56 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5925e5-871d-4d46-9f53-f2d4e9b99dc1]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:44:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:56 devstack sudo[87120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77 Apr 16 19:44:56 devstack sudo[87120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:56 devstack sudo[87120]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77" returned: 0 in 0.599s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.8fdd6d68-b66d-4e30-b8cd-93b69c56c347 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:57 devstack sudo[87125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.8fdd6d68-b66d-4e30-b8cd-93b69c56c347 1G Apr 16 19:44:57 devstack sudo[87125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:57 devstack sudo[87125]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.8fdd6d68-b66d-4e30-b8cd-93b69c56c347 1G" returned: 0 in 0.516s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b317236-82a5-42c4-ac54-d12cdca3dd77 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.8fdd6d68-b66d-4e30-b8cd-93b69c56c347 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:57 devstack sudo[87130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b317236-82a5-42c4-ac54-d12cdca3dd77 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.8fdd6d68-b66d-4e30-b8cd-93b69c56c347 Apr 16 19:44:57 devstack sudo[87130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:58 devstack sudo[87130]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b317236-82a5-42c4-ac54-d12cdca3dd77 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.8fdd6d68-b66d-4e30-b8cd-93b69c56c347" returned: 0 in 0.605s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:58 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.8fdd6d68-b66d-4e30-b8cd-93b69c56c347 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 19:44:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.8fdd6d68-b66d-4e30-b8cd-93b69c56c347 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:58 devstack sudo[87135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.8fdd6d68-b66d-4e30-b8cd-93b69c56c347 Apr 16 19:44:58 devstack sudo[87135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:58 devstack sudo[87135]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.8fdd6d68-b66d-4e30-b8cd-93b69c56c347" returned: 0 in 0.518s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:58 devstack sudo[87138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.info Apr 16 19:44:58 devstack sudo[87138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:59 devstack sudo[87138]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.info" returned: 0 in 0.504s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:59 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 19:44:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:59 devstack sudo[87144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.info Apr 16 19:44:59 devstack sudo[87144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:44:59 devstack sudo[87144]: pam_unix(sudo:session): session closed for user root Apr 16 19:44:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.info" returned: 0 in 0.500s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:44:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Acquiring lock "cinder-quobyte-eb15e5ee-2f70-4893-ab0a-ea3ef889a20b" by "_copy_volume_from_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:44:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Lock "cinder-quobyte-eb15e5ee-2f70-4893-ab0a-ea3ef889a20b" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:44:59 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] snapshot: 8fdd6d68-b66d-4e30-b8cd-93b69c56c347, volume: eb15e5ee-2f70-4893-ab0a-ea3ef889a20b, {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 19:44:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:44:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:44:59 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:44:59 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:44:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:44:59 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad4cc09-a259-482a-a266-2498721b0421]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:44:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.8fdd6d68-b66d-4e30-b8cd-93b69c56c347 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:44:59 devstack sudo[87147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.8fdd6d68-b66d-4e30-b8cd-93b69c56c347 Apr 16 19:44:59 devstack sudo[87147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:00 devstack sudo[87147]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.8fdd6d68-b66d-4e30-b8cd-93b69c56c347" returned: 0 in 0.603s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:00 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b317236-82a5-42c4-ac54-d12cdca3dd77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:45:00 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77 {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 19:45:00 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Creating direct copy from snapshot {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 19:45:00 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[101550c3-b79b-4b79-9b4f-2938b9020a98]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:45:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:00 devstack sudo[87152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77 Apr 16 19:45:00 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:01 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77" returned: 0 in 0.733s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:01 devstack cinder-volume[82569]: DEBUG cinder.utils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Path /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb15e5ee-2f70-4893-ab0a-ea3ef889a20b not found in is_blk_device check {{(pid=82569) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 19:45:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb15e5ee-2f70-4893-ab0a-ea3ef889a20b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:01 devstack sudo[87182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb15e5ee-2f70-4893-ab0a-ea3ef889a20b Apr 16 19:45:01 devstack sudo[87182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:03 devstack sudo[87182]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb15e5ee-2f70-4893-ab0a-ea3ef889a20b" returned: 0 in 2.744s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:03 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee07fa2-1890-4e82-88ef-dbbf2a759dc4]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:45:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:03 devstack sudo[87200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77 Apr 16 19:45:03 devstack sudo[87200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:04 devstack cinder-volume[82569]: DEBUG oslo_service.periodic_task [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82569) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 19:45:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:45:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:45:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:04 devstack sudo[87202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:45:04 devstack sudo[87202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:04 devstack sudo[87202]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.759s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:04 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:45:05 devstack sudo[87200]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77" returned: 0 in 1.476s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:05 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Image conversion details: src /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77, size 1024.00 MB, duration 2.74 sec, destination /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb15e5ee-2f70-4893-ab0a-ea3ef889a20b {{(pid=82569) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 19:45:05 devstack cinder-volume[82569]: INFO cinder.image.image_utils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Converted 1024.00 MB image at 373.06 MB/s Apr 16 19:45:05 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb15e5ee-2f70-4893-ab0a-ea3ef889a20b is being set with open permissions: ugo+rw: NotImplementedError Apr 16 19:45:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb15e5ee-2f70-4893-ab0a-ea3ef889a20b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:05 devstack sudo[87209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb15e5ee-2f70-4893-ab0a-ea3ef889a20b Apr 16 19:45:05 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:05 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb15e5ee-2f70-4893-ab0a-ea3ef889a20b" returned: 0 in 0.565s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:05 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Lock "cinder-quobyte-eb15e5ee-2f70-4893-ab0a-ea3ef889a20b" released by "_copy_volume_from_snapshot" :: held 6.183s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:45:05 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Acquiring lock "cinder-quobyte-8fdd6d68-b66d-4e30-b8cd-93b69c56c347" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:45:05 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-16472444-9f31-4057-845e-890770688927 tempest-VolumesActionsTest-1728231658 None] Acquiring lock "cinder-f0175689-4b8e-4898-b119-9cc1683b5679" by "attach_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:45:05 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Lock "cinder-quobyte-8fdd6d68-b66d-4e30-b8cd-93b69c56c347" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:45:05 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Deleting offline snapshot 8fdd6d68-b66d-4e30-b8cd-93b69c56c347 of volume 7b317236-82a5-42c4-ac54-d12cdca3dd77 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:45:05 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] snapshot_file for this snap is: volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.8fdd6d68-b66d-4e30-b8cd-93b69c56c347 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:45:05 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-16472444-9f31-4057-845e-890770688927 tempest-VolumesActionsTest-1728231658 None] Lock "cinder-f0175689-4b8e-4898-b119-9cc1683b5679" acquired by "attach_volume" :: waited 0.047s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:45:05 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[795e66d7-560f-4abb-a96e-9b6f6d3aacb6]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:45:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.8fdd6d68-b66d-4e30-b8cd-93b69c56c347 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:06 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-16472444-9f31-4057-845e-890770688927 tempest-VolumesActionsTest-1728231658 None] Attaching volume f0175689-4b8e-4898-b119-9cc1683b5679 to instance b9db5afa-0fb4-42cd-bf8e-f0cce2634240 at mountpoint /dev/vdb on host None. Apr 16 19:45:06 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-16472444-9f31-4057-845e-890770688927 tempest-VolumesActionsTest-1728231658 None] Attach volume completed successfully. Apr 16 19:45:06 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-16472444-9f31-4057-845e-890770688927 tempest-VolumesActionsTest-1728231658 None] Lock "cinder-f0175689-4b8e-4898-b119-9cc1683b5679" released by "attach_volume" :: held 0.111s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:45:06 devstack sudo[87212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.8fdd6d68-b66d-4e30-b8cd-93b69c56c347 Apr 16 19:45:06 devstack sudo[87212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:06 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d037eafc-6479-419f-810c-53dd7d82985d tempest-VolumesActionsTest-1728231658 None] Acquiring lock "cinder-f0175689-4b8e-4898-b119-9cc1683b5679-detach_volume" by "detach_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:45:06 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d037eafc-6479-419f-810c-53dd7d82985d tempest-VolumesActionsTest-1728231658 None] Lock "cinder-f0175689-4b8e-4898-b119-9cc1683b5679-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:45:06 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-d037eafc-6479-419f-810c-53dd7d82985d tempest-VolumesActionsTest-1728231658 None] Detaching volume f0175689-4b8e-4898-b119-9cc1683b5679 from instance b9db5afa-0fb4-42cd-bf8e-f0cce2634240. Apr 16 19:45:06 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-d037eafc-6479-419f-810c-53dd7d82985d tempest-VolumesActionsTest-1728231658 None] Detach volume completed successfully. Apr 16 19:45:06 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d037eafc-6479-419f-810c-53dd7d82985d tempest-VolumesActionsTest-1728231658 None] Lock "cinder-f0175689-4b8e-4898-b119-9cc1683b5679-detach_volume" released by "detach_volume" :: held 0.039s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:45:06 devstack sudo[87212]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.8fdd6d68-b66d-4e30-b8cd-93b69c56c347" returned: 0 in 0.903s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:06 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b317236-82a5-42c4-ac54-d12cdca3dd77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:45:06 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8ce8c3-fde4-4cc6-9f6c-9ee5acc2ed89]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:45:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:06 devstack sudo[87217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77 Apr 16 19:45:06 devstack sudo[87217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:07 devstack sudo[87217]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77" returned: 0 in 0.643s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.8fdd6d68-b66d-4e30-b8cd-93b69c56c347 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:07 devstack sudo[87223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.8fdd6d68-b66d-4e30-b8cd-93b69c56c347 Apr 16 19:45:07 devstack sudo[87223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:08 devstack sudo[87223]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.8fdd6d68-b66d-4e30-b8cd-93b69c56c347" returned: 0 in 0.542s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.8fdd6d68-b66d-4e30-b8cd-93b69c56c347 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:08 devstack sudo[87231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.8fdd6d68-b66d-4e30-b8cd-93b69c56c347 Apr 16 19:45:08 devstack sudo[87231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:08 devstack sudo[87231]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77.8fdd6d68-b66d-4e30-b8cd-93b69c56c347" returned: 0 in 0.427s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:08 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Lock "cinder-quobyte-8fdd6d68-b66d-4e30-b8cd-93b69c56c347" released by "_delete_snapshot" :: held 2.597s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:45:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.208s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:08 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-0f57176a-3dc6-4fcc-82f6-a8c7f04c4973 tempest-GroupsV314Test-32920575 None] Create group from source-group-6022ff4e-8d55-4d76-83f2-bf431e6afd21 completed successfully. Apr 16 19:45:09 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-2ef061c1-dde8-4931-bd7e-7a95a31a4147 tempest-GroupsV314Test-32920575 None] Acquiring lock "cinder-quobyte-eb15e5ee-2f70-4893-ab0a-ea3ef889a20b" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:45:09 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-2ef061c1-dde8-4931-bd7e-7a95a31a4147 tempest-GroupsV314Test-32920575 None] Lock "cinder-quobyte-eb15e5ee-2f70-4893-ab0a-ea3ef889a20b" acquired by "delete_volume" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:45:09 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e90b07-8fc2-496a-b9ac-c93d244c0077]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:45:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2ef061c1-dde8-4931-bd7e-7a95a31a4147 tempest-GroupsV314Test-32920575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb15e5ee-2f70-4893-ab0a-ea3ef889a20b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:09 devstack sudo[87260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb15e5ee-2f70-4893-ab0a-ea3ef889a20b Apr 16 19:45:09 devstack sudo[87260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:09 devstack sudo[87260]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2ef061c1-dde8-4931-bd7e-7a95a31a4147 tempest-GroupsV314Test-32920575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb15e5ee-2f70-4893-ab0a-ea3ef889a20b" returned: 0 in 0.487s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2ef061c1-dde8-4931-bd7e-7a95a31a4147 tempest-GroupsV314Test-32920575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb15e5ee-2f70-4893-ab0a-ea3ef889a20b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:09 devstack sudo[87267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb15e5ee-2f70-4893-ab0a-ea3ef889a20b Apr 16 19:45:09 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:10 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2ef061c1-dde8-4931-bd7e-7a95a31a4147 tempest-GroupsV314Test-32920575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb15e5ee-2f70-4893-ab0a-ea3ef889a20b" returned: 0 in 0.475s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:10 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-2ef061c1-dde8-4931-bd7e-7a95a31a4147 tempest-GroupsV314Test-32920575 None] Lock "cinder-quobyte-eb15e5ee-2f70-4893-ab0a-ea3ef889a20b" released by "delete_volume" :: held 0.995s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:45:10 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-2ef061c1-dde8-4931-bd7e-7a95a31a4147 tempest-GroupsV314Test-32920575 None] Created reservations ['5324b4d6-f504-4b3a-96d5-8dc4828b13e5'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:45:10 devstack cinder-volume[82569]: WARNING cinder.quota [None req-2ef061c1-dde8-4931-bd7e-7a95a31a4147 tempest-GroupsV314Test-32920575 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-612120701 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-612120701, it is now deprecated. Please use the default quota class for default quota. Apr 16 19:45:10 devstack cinder-volume[82569]: WARNING cinder.quota [None req-2ef061c1-dde8-4931-bd7e-7a95a31a4147 tempest-GroupsV314Test-32920575 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-612120701 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-612120701, it is now deprecated. Please use the default quota class for default quota. Apr 16 19:45:10 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-2ef061c1-dde8-4931-bd7e-7a95a31a4147 tempest-GroupsV314Test-32920575 None] Created reservations ['9d866889-4a20-4efe-a480-0588c4d6ad75', '7ff1e329-50e0-4f69-a9cb-ac3876020c55', 'd33563d2-7b3f-483d-b859-e8a12a466a81', '84b64fe3-0591-4878-9121-5d91910ea2fe'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:45:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2ef061c1-dde8-4931-bd7e-7a95a31a4147 tempest-GroupsV314Test-32920575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2ef061c1-dde8-4931-bd7e-7a95a31a4147 tempest-GroupsV314Test-32920575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:10 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-2ef061c1-dde8-4931-bd7e-7a95a31a4147 tempest-GroupsV314Test-32920575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:45:10 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-2ef061c1-dde8-4931-bd7e-7a95a31a4147 tempest-GroupsV314Test-32920575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:45:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2ef061c1-dde8-4931-bd7e-7a95a31a4147 tempest-GroupsV314Test-32920575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2ef061c1-dde8-4931-bd7e-7a95a31a4147 tempest-GroupsV314Test-32920575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:10 devstack sudo[87272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:45:10 devstack sudo[87272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:10 devstack sudo[87272]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2ef061c1-dde8-4931-bd7e-7a95a31a4147 tempest-GroupsV314Test-32920575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.455s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:10 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-2ef061c1-dde8-4931-bd7e-7a95a31a4147 tempest-GroupsV314Test-32920575 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:45:10 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-2ef061c1-dde8-4931-bd7e-7a95a31a4147 tempest-GroupsV314Test-32920575 None] Delete group completed successfully. Apr 16 19:45:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bec459bb-a388-4d58-bc2c-b77d8316949f tempest-GroupsV314Test-32920575 None] Acquiring lock "cinder-quobyte-7b317236-82a5-42c4-ac54-d12cdca3dd77" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:45:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bec459bb-a388-4d58-bc2c-b77d8316949f tempest-GroupsV314Test-32920575 None] Lock "cinder-quobyte-7b317236-82a5-42c4-ac54-d12cdca3dd77" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:45:11 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d36922-568c-42ac-88a1-311ea905fb97]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:45:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bec459bb-a388-4d58-bc2c-b77d8316949f tempest-GroupsV314Test-32920575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:11 devstack sudo[87309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77 Apr 16 19:45:11 devstack sudo[87309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:11 devstack sudo[87309]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bec459bb-a388-4d58-bc2c-b77d8316949f tempest-GroupsV314Test-32920575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77" returned: 0 in 0.566s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bec459bb-a388-4d58-bc2c-b77d8316949f tempest-GroupsV314Test-32920575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:12 devstack sudo[87314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77 Apr 16 19:45:12 devstack sudo[87314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:12 devstack sudo[87314]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bec459bb-a388-4d58-bc2c-b77d8316949f tempest-GroupsV314Test-32920575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b317236-82a5-42c4-ac54-d12cdca3dd77" returned: 0 in 0.488s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:12 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bec459bb-a388-4d58-bc2c-b77d8316949f tempest-GroupsV314Test-32920575 None] Lock "cinder-quobyte-7b317236-82a5-42c4-ac54-d12cdca3dd77" released by "delete_volume" :: held 1.083s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:45:12 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-bec459bb-a388-4d58-bc2c-b77d8316949f tempest-GroupsV314Test-32920575 None] Created reservations ['12fce878-0059-4102-a579-8024d3faa1dd'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:45:12 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-bec459bb-a388-4d58-bc2c-b77d8316949f tempest-GroupsV314Test-32920575 None] Created reservations ['170e4d8e-e513-48c9-b65c-2876305cc229', 'a17f8fe3-91c5-4d43-aa88-a761c1eae354', '2c5487a3-a486-49c8-b967-4d4ac61b6f6b', '418f5808-f270-4e16-94d5-fca02f9a33be'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:45:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bec459bb-a388-4d58-bc2c-b77d8316949f tempest-GroupsV314Test-32920575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bec459bb-a388-4d58-bc2c-b77d8316949f tempest-GroupsV314Test-32920575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:12 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bec459bb-a388-4d58-bc2c-b77d8316949f tempest-GroupsV314Test-32920575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:45:12 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bec459bb-a388-4d58-bc2c-b77d8316949f tempest-GroupsV314Test-32920575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:45:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bec459bb-a388-4d58-bc2c-b77d8316949f tempest-GroupsV314Test-32920575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bec459bb-a388-4d58-bc2c-b77d8316949f tempest-GroupsV314Test-32920575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:12 devstack sudo[87317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:45:12 devstack sudo[87317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:13 devstack sudo[87317]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bec459bb-a388-4d58-bc2c-b77d8316949f tempest-GroupsV314Test-32920575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.495s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:13 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-bec459bb-a388-4d58-bc2c-b77d8316949f tempest-GroupsV314Test-32920575 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:45:13 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-bec459bb-a388-4d58-bc2c-b77d8316949f tempest-GroupsV314Test-32920575 None] Delete group completed successfully. Apr 16 19:45:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-77b8f471-5041-4121-a02f-02b1da9a01fe tempest-VolumesActionsTest-1728231658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-77b8f471-5041-4121-a02f-02b1da9a01fe tempest-VolumesActionsTest-1728231658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:14 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a5c4af-beb6-4f36-98f5-4236a0573a33]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:45:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-77b8f471-5041-4121-a02f-02b1da9a01fe tempest-VolumesActionsTest-1728231658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:14 devstack sudo[87337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679 Apr 16 19:45:14 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:15 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-77b8f471-5041-4121-a02f-02b1da9a01fe tempest-VolumesActionsTest-1728231658 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679" returned: 0 in 0.535s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:15 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f16eec-edb0-4fb0-a688-16f0f3f68bdc]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:45:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-77b8f471-5041-4121-a02f-02b1da9a01fe tempest-VolumesActionsTest-1728231658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:15 devstack sudo[87342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679 Apr 16 19:45:15 devstack sudo[87342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:15 devstack sudo[87342]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-77b8f471-5041-4121-a02f-02b1da9a01fe tempest-VolumesActionsTest-1728231658 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679" returned: 0 in 0.621s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-77b8f471-5041-4121-a02f-02b1da9a01fe tempest-VolumesActionsTest-1728231658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679 /opt/stack/data/cinder/conversion/f0175689-4b8e-4898-b119-9cc1683b5679.temp_image.a3e76f44-f08a-4d30-9db3-832dee4c4812k24durqv.img {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:15 devstack sudo[87347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679 /opt/stack/data/cinder/conversion/f0175689-4b8e-4898-b119-9cc1683b5679.temp_image.a3e76f44-f08a-4d30-9db3-832dee4c4812k24durqv.img Apr 16 19:45:15 devstack sudo[87347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:18 devstack sudo[87347]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-77b8f471-5041-4121-a02f-02b1da9a01fe tempest-VolumesActionsTest-1728231658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679 /opt/stack/data/cinder/conversion/f0175689-4b8e-4898-b119-9cc1683b5679.temp_image.a3e76f44-f08a-4d30-9db3-832dee4c4812k24durqv.img" returned: 0 in 2.268s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:18 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[069e5b24-0cca-40f6-8d7c-091ced5e8233]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:45:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-77b8f471-5041-4121-a02f-02b1da9a01fe tempest-VolumesActionsTest-1728231658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:18 devstack sudo[87362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679 Apr 16 19:45:18 devstack sudo[87362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:19 devstack sudo[87362]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-77b8f471-5041-4121-a02f-02b1da9a01fe tempest-VolumesActionsTest-1728231658 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679" returned: 0 in 1.079s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:19 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-77b8f471-5041-4121-a02f-02b1da9a01fe tempest-VolumesActionsTest-1728231658 None] Image conversion details: src /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679, size 1024.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/conversion/f0175689-4b8e-4898-b119-9cc1683b5679.temp_image.a3e76f44-f08a-4d30-9db3-832dee4c4812k24durqv.img {{(pid=82569) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 19:45:19 devstack cinder-volume[82569]: INFO cinder.image.image_utils [None req-77b8f471-5041-4121-a02f-02b1da9a01fe tempest-VolumesActionsTest-1728231658 None] Converted 1024.00 MB image at 451.19 MB/s Apr 16 19:45:19 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-77b8f471-5041-4121-a02f-02b1da9a01fe tempest-VolumesActionsTest-1728231658 None] a3e76f44-f08a-4d30-9db3-832dee4c4812 was raw, no need to convert to raw {{(pid=82569) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 16 19:45:21 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:45:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Flow 'volume_create_manager' (5e0e1db5-529a-4ed9-87e0-392ed42a4c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:45:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7c212e-d303-4c46-9e9e-ba8c2298c617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7c212e-d303-4c46-9e9e-ba8c2298c617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-164478525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=091ce344-cbe8-4d1c-9fea-a7ba9e94f88f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe1b20afe9a94255b635797f7bbf0cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:45:21Z,use_quota=True,user_id='a5d192d1649e45509fc911c0586feb1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542d1c87-0fd7-47c2-a5ab-938a825e2f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542d1c87-0fd7-47c2-a5ab-938a825e2f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d419d02a-f44a-4b68-80c6-d337af7e32e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d419d02a-f44a-4b68-80c6-d337af7e32e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '091ce344-cbe8-4d1c-9fea-a7ba9e94f88f', 'volume_name': 'volume-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b13bab2-b9ba-4250-9fdd-c04796c23168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b13bab2-b9ba-4250-9fdd-c04796c23168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30013687-e2a3-4774-8c4a-b3192faeb30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:21 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Volume 091ce344-cbe8-4d1c-9fea-a7ba9e94f88f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f', 'volume_size': 1} Apr 16 19:45:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:23 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:45:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Flow 'volume_create_manager' (3cd6df9e-36de-4bb4-8530-0c11142fc635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:45:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0412f243-85fb-456b-b5c5-0e18a62b75c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0412f243-85fb-456b-b5c5-0e18a62b75c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1812278551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dafeacb2-a134-4927-a195-2fd9ca90bb79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3252acc6c89d4f45b47464f07e35f041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:45:24Z,use_quota=True,user_id='0dd5b4514fa64e8c89b9bff09d6bd0b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1ab9bbb-9506-4b8c-9fbc-61c503f95f1e),volume_type_id=a1ab9bbb-9506-4b8c-9fbc-61c503f95f1e)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d351cf-faf3-4c97-88da-6f2f5639eebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d351cf-faf3-4c97-88da-6f2f5639eebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a8e6a5-82dc-4785-bebc-7b29e57affac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a8e6a5-82dc-4785-bebc-7b29e57affac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dafeacb2-a134-4927-a195-2fd9ca90bb79', 'volume_name': 'volume-dafeacb2-a134-4927-a195-2fd9ca90bb79', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (019b12ef-46d1-45da-add8-fd1fecf4bbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (019b12ef-46d1-45da-add8-fd1fecf4bbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c03ff3ee-fc9a-4c5a-b782-c4534349daba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:23 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Volume dafeacb2-a134-4927-a195-2fd9ca90bb79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dafeacb2-a134-4927-a195-2fd9ca90bb79', 'volume_size': 1} Apr 16 19:45:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-77b8f471-5041-4121-a02f-02b1da9a01fe tempest-VolumesActionsTest-1728231658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.901s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-77b8f471-5041-4121-a02f-02b1da9a01fe tempest-VolumesActionsTest-1728231658 None] Uploaded volume to glance image-id: a3e76f44-f08a-4d30-9db3-832dee4c4812. {{(pid=82569) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 16 19:45:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.018s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-164478525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=091ce344-cbe8-4d1c-9fea-a7ba9e94f88f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe1b20afe9a94255b635797f7bbf0cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:45:21Z,use_quota=True,user_id='a5d192d1649e45509fc911c0586feb1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:45:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Creating volume 091ce344-cbe8-4d1c-9fea-a7ba9e94f88f {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:45:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:45:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:45:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:45:29 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:45:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:29 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-77b8f471-5041-4121-a02f-02b1da9a01fe tempest-VolumesActionsTest-1728231658 None] Copy volume to image completed successfully. Apr 16 19:45:29 devstack sudo[87396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f 1073741824 Apr 16 19:45:29 devstack sudo[87396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:30 devstack sudo[87396]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f 1073741824" returned: 0 in 0.553s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:30 devstack sudo[87401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f Apr 16 19:45:30 devstack sudo[87401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:30 devstack sudo[87401]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f" returned: 0 in 0.521s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:45:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.727s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1812278551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dafeacb2-a134-4927-a195-2fd9ca90bb79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3252acc6c89d4f45b47464f07e35f041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:45:24Z,use_quota=True,user_id='0dd5b4514fa64e8c89b9bff09d6bd0b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1ab9bbb-9506-4b8c-9fbc-61c503f95f1e),volume_type_id=a1ab9bbb-9506-4b8c-9fbc-61c503f95f1e)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:45:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Creating volume dafeacb2-a134-4927-a195-2fd9ca90bb79 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:45:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:45:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:45:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:45:30 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:45:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dafeacb2-a134-4927-a195-2fd9ca90bb79 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30013687-e2a3-4774-8c4a-b3192faeb30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91a54d9f-315f-46d9-8d5c-9ecb41849610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:30 devstack sudo[87404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dafeacb2-a134-4927-a195-2fd9ca90bb79 1073741824 Apr 16 19:45:30 devstack sudo[87404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:30 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Volume volume-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f (091ce344-cbe8-4d1c-9fea-a7ba9e94f88f): created successfully Apr 16 19:45:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91a54d9f-315f-46d9-8d5c-9ecb41849610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Flow 'volume_create_manager' (5e0e1db5-529a-4ed9-87e0-392ed42a4c64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:45:30 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-820284f5-2cfc-4d85-83c2-991a7a9e9528 tempest-VolumesActionsTest-676893848 None] Created volume successfully. Apr 16 19:45:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-89f2d193-6af2-4c26-903c-5ee891bf3c2d tempest-VolumesActionsTest-1728231658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:31 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-da8867f7-f607-4a5a-aae3-8572ae44145f tempest-VolumesActionsTest-676893848 None] Acquiring lock "cinder-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f" by "attach_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:45:31 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-da8867f7-f607-4a5a-aae3-8572ae44145f tempest-VolumesActionsTest-676893848 None] Lock "cinder-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f" acquired by "attach_volume" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:45:31 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-da8867f7-f607-4a5a-aae3-8572ae44145f tempest-VolumesActionsTest-676893848 None] Attaching volume 091ce344-cbe8-4d1c-9fea-a7ba9e94f88f to instance 74d4211a-3143-4a9d-a888-b1de3f008b20 at mountpoint /dev/vdb on host None. Apr 16 19:45:31 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-da8867f7-f607-4a5a-aae3-8572ae44145f tempest-VolumesActionsTest-676893848 None] Attach volume completed successfully. Apr 16 19:45:31 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-da8867f7-f607-4a5a-aae3-8572ae44145f tempest-VolumesActionsTest-676893848 None] Lock "cinder-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f" released by "attach_volume" :: held 0.061s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:45:31 devstack sudo[87404]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dafeacb2-a134-4927-a195-2fd9ca90bb79 1073741824" returned: 0 in 0.639s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dafeacb2-a134-4927-a195-2fd9ca90bb79 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:31 devstack sudo[87409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dafeacb2-a134-4927-a195-2fd9ca90bb79 Apr 16 19:45:31 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:31 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dafeacb2-a134-4927-a195-2fd9ca90bb79" returned: 0 in 0.487s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:31 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:45:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-89f2d193-6af2-4c26-903c-5ee891bf3c2d tempest-VolumesActionsTest-1728231658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.899s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:31 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c03ff3ee-fc9a-4c5a-b782-c4534349daba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dafeacb2-a134-4927-a195-2fd9ca90bb79', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:31 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (501031d7-4627-45d2-a78e-7b57487c5066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:31 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69ca0ff-b68f-4208-84d5-a56e53c9121e]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:45:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-89f2d193-6af2-4c26-903c-5ee891bf3c2d tempest-VolumesActionsTest-1728231658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:31 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Volume volume-dafeacb2-a134-4927-a195-2fd9ca90bb79 (dafeacb2-a134-4927-a195-2fd9ca90bb79): created successfully Apr 16 19:45:31 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (501031d7-4627-45d2-a78e-7b57487c5066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:31 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Flow 'volume_create_manager' (3cd6df9e-36de-4bb4-8530-0c11142fc635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:45:31 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-628fd866-2261-4359-b775-16e936238fde tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Created volume successfully. Apr 16 19:45:32 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-8a64a385-2635-4110-9c16-7dce6ee4a852 tempest-VolumesActionsTest-1008648987 None] Terminate volume connection completed successfully. Apr 16 19:45:32 devstack sudo[87412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679 Apr 16 19:45:32 devstack sudo[87412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:32 devstack sudo[87412]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-89f2d193-6af2-4c26-903c-5ee891bf3c2d tempest-VolumesActionsTest-1728231658 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679" returned: 0 in 0.520s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:32 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4678332-8b57-4c66-86fa-73bc023e1143]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:45:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-89f2d193-6af2-4c26-903c-5ee891bf3c2d tempest-VolumesActionsTest-1728231658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:32 devstack sudo[87417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679 Apr 16 19:45:32 devstack sudo[87417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:32 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-8a64a385-2635-4110-9c16-7dce6ee4a852 tempest-VolumesActionsTest-1008648987 None] Acquiring lock "cinder-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f-detach_volume" by "detach_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:45:32 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-8a64a385-2635-4110-9c16-7dce6ee4a852 tempest-VolumesActionsTest-1008648987 None] Lock "cinder-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:45:32 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-8a64a385-2635-4110-9c16-7dce6ee4a852 tempest-VolumesActionsTest-1008648987 None] Detaching volume 091ce344-cbe8-4d1c-9fea-a7ba9e94f88f from instance 74d4211a-3143-4a9d-a888-b1de3f008b20. Apr 16 19:45:32 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-8a64a385-2635-4110-9c16-7dce6ee4a852 tempest-VolumesActionsTest-1008648987 None] Detach volume completed successfully. Apr 16 19:45:32 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-8a64a385-2635-4110-9c16-7dce6ee4a852 tempest-VolumesActionsTest-1008648987 None] Lock "cinder-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f-detach_volume" released by "detach_volume" :: held 0.053s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:45:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f2763fc2-0c9f-4b02-b06a-40583c633ca2 tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f2763fc2-0c9f-4b02-b06a-40583c633ca2 tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:32 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f2763fc2-0c9f-4b02-b06a-40583c633ca2 tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:45:32 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f2763fc2-0c9f-4b02-b06a-40583c633ca2 tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:45:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f2763fc2-0c9f-4b02-b06a-40583c633ca2 tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f2763fc2-0c9f-4b02-b06a-40583c633ca2 tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:32 devstack sudo[87419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:45:32 devstack sudo[87419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:32 devstack sudo[87417]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-89f2d193-6af2-4c26-903c-5ee891bf3c2d tempest-VolumesActionsTest-1728231658 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679" returned: 0 in 0.533s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-89f2d193-6af2-4c26-903c-5ee891bf3c2d tempest-VolumesActionsTest-1728231658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679 /opt/stack/data/cinder/conversion/f0175689-4b8e-4898-b119-9cc1683b5679.temp_image.e6c0f6ef-c011-4ed1-a6ab-ee5523d1fadfyome7qfi.img {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:33 devstack sudo[87424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679 /opt/stack/data/cinder/conversion/f0175689-4b8e-4898-b119-9cc1683b5679.temp_image.e6c0f6ef-c011-4ed1-a6ab-ee5523d1fadfyome7qfi.img Apr 16 19:45:33 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:33 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-4f4c0851-ede1-428c-b72b-a3b888944eb6 tempest-VolumesActionsTest-676893848 None] Acquiring lock "cinder-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f-detach_volume" by "detach_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:45:33 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-4f4c0851-ede1-428c-b72b-a3b888944eb6 tempest-VolumesActionsTest-676893848 None] Lock "cinder-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:45:33 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-4f4c0851-ede1-428c-b72b-a3b888944eb6 tempest-VolumesActionsTest-676893848 None] Volume detach called, but volume not attached. Apr 16 19:45:33 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-4f4c0851-ede1-428c-b72b-a3b888944eb6 tempest-VolumesActionsTest-676893848 None] Lock "cinder-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f-detach_volume" released by "detach_volume" :: held 0.012s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:45:33 devstack sudo[87419]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f2763fc2-0c9f-4b02-b06a-40583c633ca2 tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.464s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:33 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-f2763fc2-0c9f-4b02-b06a-40583c633ca2 tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:45:33 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-f2763fc2-0c9f-4b02-b06a-40583c633ca2 tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Retype volume completed successfully. Apr 16 19:45:34 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d0067bad-d490-413f-9365-c5fca0623064 tempest-VolumesActionsTest-676893848 None] Acquiring lock "cinder-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:45:34 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d0067bad-d490-413f-9365-c5fca0623064 tempest-VolumesActionsTest-676893848 None] Lock "cinder-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:45:34 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d0067bad-d490-413f-9365-c5fca0623064 tempest-VolumesActionsTest-676893848 None] Acquiring lock "cinder-quobyte-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:45:34 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d0067bad-d490-413f-9365-c5fca0623064 tempest-VolumesActionsTest-676893848 None] Lock "cinder-quobyte-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f" acquired by "delete_volume" :: waited 0.051s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:45:34 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3288b68-9488-4a01-9de3-152a6d270172]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:45:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d0067bad-d490-413f-9365-c5fca0623064 tempest-VolumesActionsTest-676893848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:34 devstack sudo[87438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f Apr 16 19:45:34 devstack sudo[87438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:34 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d375d403-8515-429c-b0d6-b21f34ab013d tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Acquiring lock "cinder-dafeacb2-a134-4927-a195-2fd9ca90bb79-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:45:34 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d375d403-8515-429c-b0d6-b21f34ab013d tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Lock "cinder-dafeacb2-a134-4927-a195-2fd9ca90bb79-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:45:35 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d375d403-8515-429c-b0d6-b21f34ab013d tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Acquiring lock "cinder-quobyte-dafeacb2-a134-4927-a195-2fd9ca90bb79" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:45:35 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d375d403-8515-429c-b0d6-b21f34ab013d tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Lock "cinder-quobyte-dafeacb2-a134-4927-a195-2fd9ca90bb79" acquired by "delete_volume" :: waited 0.082s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:45:35 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63805ae-2667-4eae-ac11-f538dbfc2720]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:45:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d375d403-8515-429c-b0d6-b21f34ab013d tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dafeacb2-a134-4927-a195-2fd9ca90bb79 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:35 devstack sudo[87440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dafeacb2-a134-4927-a195-2fd9ca90bb79 Apr 16 19:45:35 devstack sudo[87440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:35 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-89f2d193-6af2-4c26-903c-5ee891bf3c2d tempest-VolumesActionsTest-1728231658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679 /opt/stack/data/cinder/conversion/f0175689-4b8e-4898-b119-9cc1683b5679.temp_image.e6c0f6ef-c011-4ed1-a6ab-ee5523d1fadfyome7qfi.img" returned: 0 in 2.528s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:35 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b2c6ed-ecd0-43c8-a700-05914423a272]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:45:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-89f2d193-6af2-4c26-903c-5ee891bf3c2d tempest-VolumesActionsTest-1728231658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:35 devstack sudo[87442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679 Apr 16 19:45:35 devstack sudo[87442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:35 devstack sudo[87438]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d0067bad-d490-413f-9365-c5fca0623064 tempest-VolumesActionsTest-676893848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f" returned: 0 in 1.232s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d0067bad-d490-413f-9365-c5fca0623064 tempest-VolumesActionsTest-676893848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:35 devstack sudo[87447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f Apr 16 19:45:35 devstack sudo[87447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:35 devstack sudo[87440]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d375d403-8515-429c-b0d6-b21f34ab013d tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dafeacb2-a134-4927-a195-2fd9ca90bb79" returned: 0 in 0.779s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d375d403-8515-429c-b0d6-b21f34ab013d tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dafeacb2-a134-4927-a195-2fd9ca90bb79 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:35 devstack sudo[87452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dafeacb2-a134-4927-a195-2fd9ca90bb79 Apr 16 19:45:35 devstack sudo[87452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:36 devstack sudo[87442]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-89f2d193-6af2-4c26-903c-5ee891bf3c2d tempest-VolumesActionsTest-1728231658 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679" returned: 0 in 0.648s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:36 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-89f2d193-6af2-4c26-903c-5ee891bf3c2d tempest-VolumesActionsTest-1728231658 None] Image conversion details: src /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679, size 1024.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/conversion/f0175689-4b8e-4898-b119-9cc1683b5679.temp_image.e6c0f6ef-c011-4ed1-a6ab-ee5523d1fadfyome7qfi.img {{(pid=82569) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 19:45:36 devstack cinder-volume[82569]: INFO cinder.image.image_utils [None req-89f2d193-6af2-4c26-903c-5ee891bf3c2d tempest-VolumesActionsTest-1728231658 None] Converted 1024.00 MB image at 404.83 MB/s Apr 16 19:45:36 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-89f2d193-6af2-4c26-903c-5ee891bf3c2d tempest-VolumesActionsTest-1728231658 None] e6c0f6ef-c011-4ed1-a6ab-ee5523d1fadf was raw, converting to qcow2 {{(pid=82569) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 16 19:45:36 devstack sudo[87447]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d0067bad-d490-413f-9365-c5fca0623064 tempest-VolumesActionsTest-676893848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f" returned: 0 in 0.499s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:36 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d0067bad-d490-413f-9365-c5fca0623064 tempest-VolumesActionsTest-676893848 None] Lock "cinder-quobyte-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f" released by "delete_volume" :: held 1.801s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:45:36 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6120fe4-169c-421a-8f03-7d0a7dcd8346]: (4, 'raw') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:45:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-89f2d193-6af2-4c26-903c-5ee891bf3c2d tempest-VolumesActionsTest-1728231658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f0175689-4b8e-4898-b119-9cc1683b5679.temp_image.e6c0f6ef-c011-4ed1-a6ab-ee5523d1fadfyome7qfi.img {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:36 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-d0067bad-d490-413f-9365-c5fca0623064 tempest-VolumesActionsTest-676893848 None] Created reservations ['2534f617-5ded-4462-8d80-26699c348dbb', '1f5b3906-1e35-482c-9063-6fa547673680', '3902443a-8164-40d3-a035-f03d6c9a2ecb', '26202a06-a9a1-4981-8b2b-03f8f120d042'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:45:36 devstack sudo[87458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f0175689-4b8e-4898-b119-9cc1683b5679.temp_image.e6c0f6ef-c011-4ed1-a6ab-ee5523d1fadfyome7qfi.img Apr 16 19:45:36 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d0067bad-d490-413f-9365-c5fca0623064 tempest-VolumesActionsTest-676893848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d0067bad-d490-413f-9365-c5fca0623064 tempest-VolumesActionsTest-676893848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:36 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d0067bad-d490-413f-9365-c5fca0623064 tempest-VolumesActionsTest-676893848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:45:36 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d0067bad-d490-413f-9365-c5fca0623064 tempest-VolumesActionsTest-676893848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:45:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d0067bad-d490-413f-9365-c5fca0623064 tempest-VolumesActionsTest-676893848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d0067bad-d490-413f-9365-c5fca0623064 tempest-VolumesActionsTest-676893848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:36 devstack sudo[87461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:45:36 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:36 devstack sudo[87452]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d375d403-8515-429c-b0d6-b21f34ab013d tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dafeacb2-a134-4927-a195-2fd9ca90bb79" returned: 0 in 0.543s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:36 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d375d403-8515-429c-b0d6-b21f34ab013d tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Lock "cinder-quobyte-dafeacb2-a134-4927-a195-2fd9ca90bb79" released by "delete_volume" :: held 1.377s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:45:36 devstack cinder-volume[82569]: WARNING cinder.quota [None req-d375d403-8515-429c-b0d6-b21f34ab013d tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 16 19:45:36 devstack cinder-volume[82569]: WARNING cinder.quota [None req-d375d403-8515-429c-b0d6-b21f34ab013d tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 16 19:45:36 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-d375d403-8515-429c-b0d6-b21f34ab013d tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Created reservations ['36b9415c-d1ac-4445-a265-d42d9e763920', '7fd24819-0388-433a-8fc8-962d20270ddc', '56ee7602-1b2c-4271-aebd-c47d4a9b6b48', '1f482222-3da6-4906-9b53-2cdee96be4b0'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:45:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d375d403-8515-429c-b0d6-b21f34ab013d tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d375d403-8515-429c-b0d6-b21f34ab013d tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:36 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d375d403-8515-429c-b0d6-b21f34ab013d tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:45:36 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d375d403-8515-429c-b0d6-b21f34ab013d tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:45:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d375d403-8515-429c-b0d6-b21f34ab013d tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d375d403-8515-429c-b0d6-b21f34ab013d tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:36 devstack sudo[87463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:45:36 devstack sudo[87463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:37 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d0067bad-d490-413f-9365-c5fca0623064 tempest-VolumesActionsTest-676893848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.653s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:37 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:37 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-d0067bad-d490-413f-9365-c5fca0623064 tempest-VolumesActionsTest-676893848 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:45:37 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-d0067bad-d490-413f-9365-c5fca0623064 tempest-VolumesActionsTest-676893848 None] Deleted volume successfully. Apr 16 19:45:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-89f2d193-6af2-4c26-903c-5ee891bf3c2d tempest-VolumesActionsTest-1728231658 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f0175689-4b8e-4898-b119-9cc1683b5679.temp_image.e6c0f6ef-c011-4ed1-a6ab-ee5523d1fadfyome7qfi.img" returned: 0 in 0.794s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-89f2d193-6af2-4c26-903c-5ee891bf3c2d tempest-VolumesActionsTest-1728231658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f0175689-4b8e-4898-b119-9cc1683b5679.temp_image.e6c0f6ef-c011-4ed1-a6ab-ee5523d1fadfyome7qfi.img {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:37 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d0067bad-d490-413f-9365-c5fca0623064 tempest-VolumesActionsTest-676893848 None] Lock "cinder-091ce344-cbe8-4d1c-9fea-a7ba9e94f88f-delete_volume" released by "delete_volume" :: held 2.844s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:45:37 devstack sudo[87469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f0175689-4b8e-4898-b119-9cc1683b5679.temp_image.e6c0f6ef-c011-4ed1-a6ab-ee5523d1fadfyome7qfi.img Apr 16 19:45:37 devstack sudo[87469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:37 devstack sudo[87463]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d375d403-8515-429c-b0d6-b21f34ab013d tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.607s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:37 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-d375d403-8515-429c-b0d6-b21f34ab013d tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:45:37 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-d375d403-8515-429c-b0d6-b21f34ab013d tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Deleted volume successfully. Apr 16 19:45:37 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d375d403-8515-429c-b0d6-b21f34ab013d tempest-VolumeRetypeWithoutMigrationTest-1666750666 None] Lock "cinder-dafeacb2-a134-4927-a195-2fd9ca90bb79-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:45:37 devstack sudo[87469]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-89f2d193-6af2-4c26-903c-5ee891bf3c2d tempest-VolumesActionsTest-1728231658 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f0175689-4b8e-4898-b119-9cc1683b5679.temp_image.e6c0f6ef-c011-4ed1-a6ab-ee5523d1fadfyome7qfi.img" returned: 1 in 0.567s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-89f2d193-6af2-4c26-903c-5ee891bf3c2d tempest-VolumesActionsTest-1728231658 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f0175689-4b8e-4898-b119-9cc1683b5679.temp_image.e6c0f6ef-c011-4ed1-a6ab-ee5523d1fadfyome7qfi.img' failed. Not Retrying. {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 19:45:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-89f2d193-6af2-4c26-903c-5ee891bf3c2d tempest-VolumesActionsTest-1728231658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f0175689-4b8e-4898-b119-9cc1683b5679.temp_image.e6c0f6ef-c011-4ed1-a6ab-ee5523d1fadfyome7qfi.img /opt/stack/data/cinder/conversion/vol_upload_0dwbclj3 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:37 devstack sudo[87476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f0175689-4b8e-4898-b119-9cc1683b5679.temp_image.e6c0f6ef-c011-4ed1-a6ab-ee5523d1fadfyome7qfi.img /opt/stack/data/cinder/conversion/vol_upload_0dwbclj3 Apr 16 19:45:37 devstack sudo[87476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:38 devstack sudo[87476]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-89f2d193-6af2-4c26-903c-5ee891bf3c2d tempest-VolumesActionsTest-1728231658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f0175689-4b8e-4898-b119-9cc1683b5679.temp_image.e6c0f6ef-c011-4ed1-a6ab-ee5523d1fadfyome7qfi.img /opt/stack/data/cinder/conversion/vol_upload_0dwbclj3" returned: 0 in 0.780s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:38 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-89f2d193-6af2-4c26-903c-5ee891bf3c2d tempest-VolumesActionsTest-1728231658 None] Image conversion details: src /opt/stack/data/cinder/conversion/f0175689-4b8e-4898-b119-9cc1683b5679.temp_image.e6c0f6ef-c011-4ed1-a6ab-ee5523d1fadfyome7qfi.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_0dwbclj3 {{(pid=82569) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 19:45:38 devstack cinder-volume[82569]: INFO cinder.image.image_utils [None req-89f2d193-6af2-4c26-903c-5ee891bf3c2d tempest-VolumesActionsTest-1728231658 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 16 19:45:38 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc8755a-6043-47f0-95ea-489eaf9a4299]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:45:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-89f2d193-6af2-4c26-903c-5ee891bf3c2d tempest-VolumesActionsTest-1728231658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_0dwbclj3 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:38 devstack sudo[87521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_0dwbclj3 Apr 16 19:45:38 devstack sudo[87521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:38 devstack sudo[87521]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-89f2d193-6af2-4c26-903c-5ee891bf3c2d tempest-VolumesActionsTest-1728231658 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_0dwbclj3" returned: 0 in 0.579s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-89f2d193-6af2-4c26-903c-5ee891bf3c2d tempest-VolumesActionsTest-1728231658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.238s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-89f2d193-6af2-4c26-903c-5ee891bf3c2d tempest-VolumesActionsTest-1728231658 None] Uploaded volume to glance image-id: e6c0f6ef-c011-4ed1-a6ab-ee5523d1fadf. {{(pid=82569) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 16 19:45:40 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-89f2d193-6af2-4c26-903c-5ee891bf3c2d tempest-VolumesActionsTest-1728231658 None] Copy volume to image completed successfully. Apr 16 19:45:40 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-7581911b-5e4f-4a07-9504-51917f27093c tempest-VolumesActionsTest-1728231658 None] Acquiring lock "cinder-f0175689-4b8e-4898-b119-9cc1683b5679-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:45:40 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-7581911b-5e4f-4a07-9504-51917f27093c tempest-VolumesActionsTest-1728231658 None] Lock "cinder-f0175689-4b8e-4898-b119-9cc1683b5679-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:45:40 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-7581911b-5e4f-4a07-9504-51917f27093c tempest-VolumesActionsTest-1728231658 None] Acquiring lock "cinder-quobyte-f0175689-4b8e-4898-b119-9cc1683b5679" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:45:40 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-7581911b-5e4f-4a07-9504-51917f27093c tempest-VolumesActionsTest-1728231658 None] Lock "cinder-quobyte-f0175689-4b8e-4898-b119-9cc1683b5679" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:45:40 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b05187e-e5aa-4be8-abd3-ac0abecaba59]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:45:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7581911b-5e4f-4a07-9504-51917f27093c tempest-VolumesActionsTest-1728231658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:41 devstack sudo[87533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679 Apr 16 19:45:41 devstack sudo[87533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:41 devstack sudo[87533]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7581911b-5e4f-4a07-9504-51917f27093c tempest-VolumesActionsTest-1728231658 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679" returned: 0 in 0.514s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7581911b-5e4f-4a07-9504-51917f27093c tempest-VolumesActionsTest-1728231658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:41 devstack sudo[87538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679 Apr 16 19:45:41 devstack sudo[87538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:41 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:45:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Flow 'volume_create_manager' (05a475c3-f466-4199-9abf-c3aeb301e93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:45:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da11725-0018-45d2-9cf4-0d8d2c54d674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da11725-0018-45d2-9cf4-0d8d2c54d674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-991772433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d10632-fdc1-4fa1-8b3c-46866886934d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6dbfaa52afb4731946c556a54f67747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:45:42Z,use_quota=True,user_id='4458b925111a415fb0cf2f1f5757f860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc944be-ab7c-4392-a72a-88962d998cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc944be-ab7c-4392-a72a-88962d998cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb2b7cb4-6f19-42f7-91a1-86372ce6ec4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb2b7cb4-6f19-42f7-91a1-86372ce6ec4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50d10632-fdc1-4fa1-8b3c-46866886934d', 'volume_name': 'volume-50d10632-fdc1-4fa1-8b3c-46866886934d', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47bb5572-aa70-4d01-9b4b-1df8ea8ef499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47bb5572-aa70-4d01-9b4b-1df8ea8ef499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:41 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4561238e-09d2-460a-805e-fb0bf62ce5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:41 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Volume 50d10632-fdc1-4fa1-8b3c-46866886934d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50d10632-fdc1-4fa1-8b3c-46866886934d', 'volume_size': 1} Apr 16 19:45:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:41 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-991772433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d10632-fdc1-4fa1-8b3c-46866886934d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6dbfaa52afb4731946c556a54f67747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:45:42Z,use_quota=True,user_id='4458b925111a415fb0cf2f1f5757f860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:45:41 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Creating volume 50d10632-fdc1-4fa1-8b3c-46866886934d {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:45:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:41 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:45:41 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:45:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:41 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:45:41 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:45:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-50d10632-fdc1-4fa1-8b3c-46866886934d 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:41 devstack sudo[87540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-50d10632-fdc1-4fa1-8b3c-46866886934d 1073741824 Apr 16 19:45:41 devstack sudo[87540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:41 devstack sudo[87538]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7581911b-5e4f-4a07-9504-51917f27093c tempest-VolumesActionsTest-1728231658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0175689-4b8e-4898-b119-9cc1683b5679" returned: 0 in 0.462s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:41 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-7581911b-5e4f-4a07-9504-51917f27093c tempest-VolumesActionsTest-1728231658 None] Lock "cinder-quobyte-f0175689-4b8e-4898-b119-9cc1683b5679" released by "delete_volume" :: held 1.001s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:45:41 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-7581911b-5e4f-4a07-9504-51917f27093c tempest-VolumesActionsTest-1728231658 None] Created reservations ['3f4207bd-f447-4a74-8130-3895d9f3f1f2', '9c4cdffc-ad99-4380-8814-2b2c8b940804', '1025ef49-334c-4584-bf0c-3bff0eb01a16', 'e3ef1b65-a9be-4e10-83c7-e9ffb3acb06d'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:45:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7581911b-5e4f-4a07-9504-51917f27093c tempest-VolumesActionsTest-1728231658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7581911b-5e4f-4a07-9504-51917f27093c tempest-VolumesActionsTest-1728231658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:42 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7581911b-5e4f-4a07-9504-51917f27093c tempest-VolumesActionsTest-1728231658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:45:42 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7581911b-5e4f-4a07-9504-51917f27093c tempest-VolumesActionsTest-1728231658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:45:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7581911b-5e4f-4a07-9504-51917f27093c tempest-VolumesActionsTest-1728231658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7581911b-5e4f-4a07-9504-51917f27093c tempest-VolumesActionsTest-1728231658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:42 devstack sudo[87543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:45:42 devstack sudo[87543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:42 devstack sudo[87540]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-50d10632-fdc1-4fa1-8b3c-46866886934d 1073741824" returned: 0 in 0.586s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-50d10632-fdc1-4fa1-8b3c-46866886934d {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:42 devstack sudo[87548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-50d10632-fdc1-4fa1-8b3c-46866886934d Apr 16 19:45:42 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:42 devstack sudo[87543]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7581911b-5e4f-4a07-9504-51917f27093c tempest-VolumesActionsTest-1728231658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.487s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:42 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-7581911b-5e4f-4a07-9504-51917f27093c tempest-VolumesActionsTest-1728231658 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:45:42 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-7581911b-5e4f-4a07-9504-51917f27093c tempest-VolumesActionsTest-1728231658 None] Deleted volume successfully. Apr 16 19:45:42 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-7581911b-5e4f-4a07-9504-51917f27093c tempest-VolumesActionsTest-1728231658 None] Lock "cinder-f0175689-4b8e-4898-b119-9cc1683b5679-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:45:42 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-50d10632-fdc1-4fa1-8b3c-46866886934d" returned: 0 in 0.470s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:42 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:45:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:42 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4561238e-09d2-460a-805e-fb0bf62ce5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50d10632-fdc1-4fa1-8b3c-46866886934d', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:42 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca173089-c717-4fa8-a29b-57cadcd3786a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:42 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Volume volume-50d10632-fdc1-4fa1-8b3c-46866886934d (50d10632-fdc1-4fa1-8b3c-46866886934d): created successfully Apr 16 19:45:42 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca173089-c717-4fa8-a29b-57cadcd3786a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:42 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Flow 'volume_create_manager' (05a475c3-f466-4199-9abf-c3aeb301e93f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:45:42 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-2c05dcd3-76d2-4294-967c-5e051392a445 tempest-VolumesServicesTestJSON-797025522 None] Created volume successfully. Apr 16 19:45:43 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:45:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Flow 'volume_create_manager' (119ca45a-a50a-4d45-a9a4-211f0140b791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:45:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8774e48c-c51a-48c8-a229-25cdce0d313c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8774e48c-c51a-48c8-a229-25cdce0d313c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1333662023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab90885c-4b0d-487d-9e2a-de7851525b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe1b20afe9a94255b635797f7bbf0cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:45:44Z,use_quota=True,user_id='a5d192d1649e45509fc911c0586feb1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c296276e-74f4-4c78-b140-f6d3a4bd1a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c296276e-74f4-4c78-b140-f6d3a4bd1a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a80def9-5ef1-4a6f-96d5-6a65ca3567e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a80def9-5ef1-4a6f-96d5-6a65ca3567e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab90885c-4b0d-487d-9e2a-de7851525b3b', 'volume_name': 'volume-ab90885c-4b0d-487d-9e2a-de7851525b3b', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc79790-f871-489e-b082-5cc3891268fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc79790-f871-489e-b082-5cc3891268fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de0aef4-94b2-4beb-bd82-0098367225ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:43 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Volume ab90885c-4b0d-487d-9e2a-de7851525b3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab90885c-4b0d-487d-9e2a-de7851525b3b', 'volume_size': 1} Apr 16 19:45:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:43 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1333662023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab90885c-4b0d-487d-9e2a-de7851525b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe1b20afe9a94255b635797f7bbf0cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:45:44Z,use_quota=True,user_id='a5d192d1649e45509fc911c0586feb1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:45:43 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Creating volume ab90885c-4b0d-487d-9e2a-de7851525b3b {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:45:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:43 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:45:43 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:45:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:43 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:45:43 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:45:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ab90885c-4b0d-487d-9e2a-de7851525b3b 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:43 devstack sudo[87554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ab90885c-4b0d-487d-9e2a-de7851525b3b 1073741824 Apr 16 19:45:43 devstack sudo[87554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-85d3a4fe-e840-4443-a94e-130f44c29be0 tempest-VolumesServicesTestJSON-797025522 None] Acquiring lock "cinder-50d10632-fdc1-4fa1-8b3c-46866886934d-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:45:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-85d3a4fe-e840-4443-a94e-130f44c29be0 tempest-VolumesServicesTestJSON-797025522 None] Lock "cinder-50d10632-fdc1-4fa1-8b3c-46866886934d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:45:44 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-85d3a4fe-e840-4443-a94e-130f44c29be0 tempest-VolumesServicesTestJSON-797025522 None] Acquiring lock "cinder-quobyte-50d10632-fdc1-4fa1-8b3c-46866886934d" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:45:44 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-85d3a4fe-e840-4443-a94e-130f44c29be0 tempest-VolumesServicesTestJSON-797025522 None] Lock "cinder-quobyte-50d10632-fdc1-4fa1-8b3c-46866886934d" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:45:44 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a20714-fc48-4234-bde0-0b6b85c846cf]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:45:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-85d3a4fe-e840-4443-a94e-130f44c29be0 tempest-VolumesServicesTestJSON-797025522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-50d10632-fdc1-4fa1-8b3c-46866886934d {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:44 devstack sudo[87557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-50d10632-fdc1-4fa1-8b3c-46866886934d Apr 16 19:45:44 devstack sudo[87557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:44 devstack sudo[87554]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ab90885c-4b0d-487d-9e2a-de7851525b3b 1073741824" returned: 0 in 0.635s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ab90885c-4b0d-487d-9e2a-de7851525b3b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:44 devstack sudo[87562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ab90885c-4b0d-487d-9e2a-de7851525b3b Apr 16 19:45:44 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:44 devstack sudo[87557]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-85d3a4fe-e840-4443-a94e-130f44c29be0 tempest-VolumesServicesTestJSON-797025522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-50d10632-fdc1-4fa1-8b3c-46866886934d" returned: 0 in 0.626s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-85d3a4fe-e840-4443-a94e-130f44c29be0 tempest-VolumesServicesTestJSON-797025522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-50d10632-fdc1-4fa1-8b3c-46866886934d {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:44 devstack sudo[87567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-50d10632-fdc1-4fa1-8b3c-46866886934d Apr 16 19:45:44 devstack sudo[87567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:44 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ab90885c-4b0d-487d-9e2a-de7851525b3b" returned: 0 in 0.477s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:45:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:44 devstack cinder-volume[82569]: DEBUG dbcounter [-] [82569] Writing DB stats cinder:SELECT=81,cinder:UPDATE=65,cinder:INSERT=18,cinder:DELETE=4 {{(pid=82569) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:45:44 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de0aef4-94b2-4beb-bd82-0098367225ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab90885c-4b0d-487d-9e2a-de7851525b3b', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:44 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113d884f-2c17-4a38-ba0f-e266ea55a89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:44 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Volume volume-ab90885c-4b0d-487d-9e2a-de7851525b3b (ab90885c-4b0d-487d-9e2a-de7851525b3b): created successfully Apr 16 19:45:44 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113d884f-2c17-4a38-ba0f-e266ea55a89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:44 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Flow 'volume_create_manager' (119ca45a-a50a-4d45-a9a4-211f0140b791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:45:44 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-488264df-d3ca-40aa-8617-84eeecfd6208 tempest-VolumesActionsTest-676893848 None] Created volume successfully. Apr 16 19:45:45 devstack sudo[87567]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-85d3a4fe-e840-4443-a94e-130f44c29be0 tempest-VolumesServicesTestJSON-797025522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-50d10632-fdc1-4fa1-8b3c-46866886934d" returned: 0 in 0.543s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:45 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-85d3a4fe-e840-4443-a94e-130f44c29be0 tempest-VolumesServicesTestJSON-797025522 None] Lock "cinder-quobyte-50d10632-fdc1-4fa1-8b3c-46866886934d" released by "delete_volume" :: held 1.192s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:45:45 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-85d3a4fe-e840-4443-a94e-130f44c29be0 tempest-VolumesServicesTestJSON-797025522 None] Created reservations ['b19f5756-cbb6-44c0-a2b2-391fc94b37f4', '31e469d9-09d5-48dd-9c5a-1fa99c583597', '353baeed-e05f-4ffe-bf26-3e5feb18d206', 'f7f3eb00-82b8-4216-abf2-1b196f6cca4b'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:45:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-85d3a4fe-e840-4443-a94e-130f44c29be0 tempest-VolumesServicesTestJSON-797025522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-85d3a4fe-e840-4443-a94e-130f44c29be0 tempest-VolumesServicesTestJSON-797025522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:45 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-85d3a4fe-e840-4443-a94e-130f44c29be0 tempest-VolumesServicesTestJSON-797025522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:45:45 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-85d3a4fe-e840-4443-a94e-130f44c29be0 tempest-VolumesServicesTestJSON-797025522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:45:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-85d3a4fe-e840-4443-a94e-130f44c29be0 tempest-VolumesServicesTestJSON-797025522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-85d3a4fe-e840-4443-a94e-130f44c29be0 tempest-VolumesServicesTestJSON-797025522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:45 devstack sudo[87572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:45:45 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:45 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-26a8d4e3-bf37-4dcc-b294-35196e6222ec tempest-VolumesActionsTest-1008648987 None] Acquiring lock "cinder-ab90885c-4b0d-487d-9e2a-de7851525b3b-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:45:45 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-26a8d4e3-bf37-4dcc-b294-35196e6222ec tempest-VolumesActionsTest-1008648987 None] Lock "cinder-ab90885c-4b0d-487d-9e2a-de7851525b3b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:45:45 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-26a8d4e3-bf37-4dcc-b294-35196e6222ec tempest-VolumesActionsTest-1008648987 None] Acquiring lock "cinder-quobyte-ab90885c-4b0d-487d-9e2a-de7851525b3b" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:45:45 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-26a8d4e3-bf37-4dcc-b294-35196e6222ec tempest-VolumesActionsTest-1008648987 None] Lock "cinder-quobyte-ab90885c-4b0d-487d-9e2a-de7851525b3b" acquired by "delete_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:45:45 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-85d3a4fe-e840-4443-a94e-130f44c29be0 tempest-VolumesServicesTestJSON-797025522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.565s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:45 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-85d3a4fe-e840-4443-a94e-130f44c29be0 tempest-VolumesServicesTestJSON-797025522 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:45:45 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac379e56-1f7f-4241-b2d0-b7eb06de410f]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:45:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-26a8d4e3-bf37-4dcc-b294-35196e6222ec tempest-VolumesActionsTest-1008648987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ab90885c-4b0d-487d-9e2a-de7851525b3b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:45 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-85d3a4fe-e840-4443-a94e-130f44c29be0 tempest-VolumesServicesTestJSON-797025522 None] Deleted volume successfully. Apr 16 19:45:45 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-85d3a4fe-e840-4443-a94e-130f44c29be0 tempest-VolumesServicesTestJSON-797025522 None] Lock "cinder-50d10632-fdc1-4fa1-8b3c-46866886934d-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:45:45 devstack sudo[87575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ab90885c-4b0d-487d-9e2a-de7851525b3b Apr 16 19:45:45 devstack sudo[87575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:46 devstack sudo[87575]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-26a8d4e3-bf37-4dcc-b294-35196e6222ec tempest-VolumesActionsTest-1008648987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ab90885c-4b0d-487d-9e2a-de7851525b3b" returned: 0 in 0.580s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-26a8d4e3-bf37-4dcc-b294-35196e6222ec tempest-VolumesActionsTest-1008648987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ab90885c-4b0d-487d-9e2a-de7851525b3b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:46 devstack sudo[87580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ab90885c-4b0d-487d-9e2a-de7851525b3b Apr 16 19:45:46 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:46 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:45:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Flow 'volume_create_manager' (d09fb342-6a47-4b19-a24c-41769b0f795a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:45:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e20cc29a-050c-456f-ad59-1ce4977ca9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e20cc29a-050c-456f-ad59-1ce4977ca9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1016947104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02433a0c-0392-49e9-bf86-08cf2463118c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27737b9f744e4149b9e4c5684b517e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:45:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:45:46Z,use_quota=True,user_id='f95732a0437d49768a108bb4adc1681a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbfe5e54-33e9-47a3-9ea6-d12a433d680e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbfe5e54-33e9-47a3-9ea6-d12a433d680e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3363725a-2a5b-49fd-8b32-adb5c367acc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3363725a-2a5b-49fd-8b32-adb5c367acc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02433a0c-0392-49e9-bf86-08cf2463118c', 'volume_name': 'volume-02433a0c-0392-49e9-bf86-08cf2463118c', 'volume_size': 2}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8b1ea35-22a2-4d8c-a9bb-b7355cca0ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8b1ea35-22a2-4d8c-a9bb-b7355cca0ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48504a51-e3d0-4fd1-86ef-763d174704f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:46 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Volume 02433a0c-0392-49e9-bf86-08cf2463118c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02433a0c-0392-49e9-bf86-08cf2463118c', 'volume_size': 2} Apr 16 19:45:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:46 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1016947104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02433a0c-0392-49e9-bf86-08cf2463118c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27737b9f744e4149b9e4c5684b517e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:45:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:45:46Z,use_quota=True,user_id='f95732a0437d49768a108bb4adc1681a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:45:46 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Creating volume 02433a0c-0392-49e9-bf86-08cf2463118c {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:45:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:46 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:45:46 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:45:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:46 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:45:46 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:45:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-02433a0c-0392-49e9-bf86-08cf2463118c 2147483648 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:46 devstack sudo[87582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-02433a0c-0392-49e9-bf86-08cf2463118c 2147483648 Apr 16 19:45:46 devstack sudo[87582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:46 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-26a8d4e3-bf37-4dcc-b294-35196e6222ec tempest-VolumesActionsTest-1008648987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ab90885c-4b0d-487d-9e2a-de7851525b3b" returned: 0 in 0.550s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:47 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-26a8d4e3-bf37-4dcc-b294-35196e6222ec tempest-VolumesActionsTest-1008648987 None] Lock "cinder-quobyte-ab90885c-4b0d-487d-9e2a-de7851525b3b" released by "delete_volume" :: held 1.163s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:45:47 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-26a8d4e3-bf37-4dcc-b294-35196e6222ec tempest-VolumesActionsTest-1008648987 None] Created reservations ['ee322c39-26d1-43d1-a86c-da6c8db3b05f', '9e41a84b-844c-4c93-8f33-a866de611052', 'f85db8d3-91c0-4686-9e87-1743b415940e', '7a465e70-7222-4465-bccc-984452bde7f9'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:45:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-26a8d4e3-bf37-4dcc-b294-35196e6222ec tempest-VolumesActionsTest-1008648987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-26a8d4e3-bf37-4dcc-b294-35196e6222ec tempest-VolumesActionsTest-1008648987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:47 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-26a8d4e3-bf37-4dcc-b294-35196e6222ec tempest-VolumesActionsTest-1008648987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:45:47 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-26a8d4e3-bf37-4dcc-b294-35196e6222ec tempest-VolumesActionsTest-1008648987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:45:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-26a8d4e3-bf37-4dcc-b294-35196e6222ec tempest-VolumesActionsTest-1008648987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-26a8d4e3-bf37-4dcc-b294-35196e6222ec tempest-VolumesActionsTest-1008648987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:47 devstack sudo[87588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:45:47 devstack sudo[87588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:47 devstack sudo[87582]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-02433a0c-0392-49e9-bf86-08cf2463118c 2147483648" returned: 0 in 0.636s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-02433a0c-0392-49e9-bf86-08cf2463118c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:47 devstack sudo[87590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-02433a0c-0392-49e9-bf86-08cf2463118c Apr 16 19:45:47 devstack sudo[87590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:47 devstack sudo[87588]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-26a8d4e3-bf37-4dcc-b294-35196e6222ec tempest-VolumesActionsTest-1008648987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.562s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:47 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-26a8d4e3-bf37-4dcc-b294-35196e6222ec tempest-VolumesActionsTest-1008648987 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:45:47 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-26a8d4e3-bf37-4dcc-b294-35196e6222ec tempest-VolumesActionsTest-1008648987 None] Deleted volume successfully. Apr 16 19:45:47 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-26a8d4e3-bf37-4dcc-b294-35196e6222ec tempest-VolumesActionsTest-1008648987 None] Lock "cinder-ab90885c-4b0d-487d-9e2a-de7851525b3b-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:45:47 devstack sudo[87590]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-02433a0c-0392-49e9-bf86-08cf2463118c" returned: 0 in 0.574s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:47 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:45:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48504a51-e3d0-4fd1-86ef-763d174704f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02433a0c-0392-49e9-bf86-08cf2463118c', 'volume_size': 2}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a2384d6-a536-4713-bb4e-3ea5806401fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:47 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Volume volume-02433a0c-0392-49e9-bf86-08cf2463118c (02433a0c-0392-49e9-bf86-08cf2463118c): created successfully Apr 16 19:45:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a2384d6-a536-4713-bb4e-3ea5806401fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Flow 'volume_create_manager' (d09fb342-6a47-4b19-a24c-41769b0f795a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:45:47 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-880ff6df-3f40-4388-89c0-4d9987035932 tempest-VolumesCloneNegativeTest-120745050 None] Created volume successfully. Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Flow 'volume_create_manager' (dc091f93-740b-4781-9831-dcb440a50000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf419ba-cb2f-4cfa-b2c3-d8ca331e5f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf419ba-cb2f-4cfa-b2c3-d8ca331e5f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-925492245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e36dfb4-435e-4bd3-bfce-76b1f77b0199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe1b20afe9a94255b635797f7bbf0cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:45:48Z,use_quota=True,user_id='a5d192d1649e45509fc911c0586feb1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f757923-757b-44c2-879e-7baeae64b3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f757923-757b-44c2-879e-7baeae64b3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64993c2a-03fb-4db3-8b1a-db99b7887aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64993c2a-03fb-4db3-8b1a-db99b7887aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e36dfb4-435e-4bd3-bfce-76b1f77b0199', 'volume_name': 'volume-7e36dfb4-435e-4bd3-bfce-76b1f77b0199', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4cfffd2-8fbc-430d-83d2-6ab42b71c8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4cfffd2-8fbc-430d-83d2-6ab42b71c8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0300f56-8f89-4293-a1df-efc8484d35ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:48 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Volume 7e36dfb4-435e-4bd3-bfce-76b1f77b0199: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e36dfb4-435e-4bd3-bfce-76b1f77b0199', 'volume_size': 1} Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-925492245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e36dfb4-435e-4bd3-bfce-76b1f77b0199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe1b20afe9a94255b635797f7bbf0cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:45:48Z,use_quota=True,user_id='a5d192d1649e45509fc911c0586feb1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Creating volume 7e36dfb4-435e-4bd3-bfce-76b1f77b0199 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:45:48 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7e36dfb4-435e-4bd3-bfce-76b1f77b0199 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:48 devstack sudo[87595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7e36dfb4-435e-4bd3-bfce-76b1f77b0199 1073741824 Apr 16 19:45:48 devstack sudo[87595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-fcbf36ef-ee86-4b67-9414-53e7d454cc31 tempest-VolumesCloneNegativeTest-120745050 None] Acquiring lock "cinder-02433a0c-0392-49e9-bf86-08cf2463118c-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-fcbf36ef-ee86-4b67-9414-53e7d454cc31 tempest-VolumesCloneNegativeTest-120745050 None] Lock "cinder-02433a0c-0392-49e9-bf86-08cf2463118c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-fcbf36ef-ee86-4b67-9414-53e7d454cc31 tempest-VolumesCloneNegativeTest-120745050 None] Acquiring lock "cinder-quobyte-02433a0c-0392-49e9-bf86-08cf2463118c" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-fcbf36ef-ee86-4b67-9414-53e7d454cc31 tempest-VolumesCloneNegativeTest-120745050 None] Lock "cinder-quobyte-02433a0c-0392-49e9-bf86-08cf2463118c" acquired by "delete_volume" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddac3200-eca2-4675-8eac-3546fc59a1d2]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-fcbf36ef-ee86-4b67-9414-53e7d454cc31 tempest-VolumesCloneNegativeTest-120745050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-02433a0c-0392-49e9-bf86-08cf2463118c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:48 devstack sudo[87600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-02433a0c-0392-49e9-bf86-08cf2463118c Apr 16 19:45:48 devstack sudo[87600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:48 devstack sudo[87595]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7e36dfb4-435e-4bd3-bfce-76b1f77b0199 1073741824" returned: 0 in 0.621s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7e36dfb4-435e-4bd3-bfce-76b1f77b0199 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:49 devstack sudo[87602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7e36dfb4-435e-4bd3-bfce-76b1f77b0199 Apr 16 19:45:49 devstack sudo[87602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:49 devstack sudo[87600]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-fcbf36ef-ee86-4b67-9414-53e7d454cc31 tempest-VolumesCloneNegativeTest-120745050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-02433a0c-0392-49e9-bf86-08cf2463118c" returned: 0 in 0.561s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-fcbf36ef-ee86-4b67-9414-53e7d454cc31 tempest-VolumesCloneNegativeTest-120745050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-02433a0c-0392-49e9-bf86-08cf2463118c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:49 devstack sudo[87607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-02433a0c-0392-49e9-bf86-08cf2463118c Apr 16 19:45:49 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:49 devstack sudo[87602]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7e36dfb4-435e-4bd3-bfce-76b1f77b0199" returned: 0 in 0.510s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:49 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:45:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0300f56-8f89-4293-a1df-efc8484d35ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e36dfb4-435e-4bd3-bfce-76b1f77b0199', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef5f01d-e9e7-411b-9e30-dac8380ccddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:49 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Volume volume-7e36dfb4-435e-4bd3-bfce-76b1f77b0199 (7e36dfb4-435e-4bd3-bfce-76b1f77b0199): created successfully Apr 16 19:45:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef5f01d-e9e7-411b-9e30-dac8380ccddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Flow 'volume_create_manager' (dc091f93-740b-4781-9831-dcb440a50000) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:45:49 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-458a1078-0493-4c84-a29f-f01dcc67527d tempest-VolumesActionsTest-676893848 None] Created volume successfully. Apr 16 19:45:49 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-fcbf36ef-ee86-4b67-9414-53e7d454cc31 tempest-VolumesCloneNegativeTest-120745050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-02433a0c-0392-49e9-bf86-08cf2463118c" returned: 0 in 0.483s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:49 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-fcbf36ef-ee86-4b67-9414-53e7d454cc31 tempest-VolumesCloneNegativeTest-120745050 None] Lock "cinder-quobyte-02433a0c-0392-49e9-bf86-08cf2463118c" released by "delete_volume" :: held 1.067s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:45:49 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-fcbf36ef-ee86-4b67-9414-53e7d454cc31 tempest-VolumesCloneNegativeTest-120745050 None] Created reservations ['02999801-32c5-48a7-94bf-84b2e50cf564', 'c8d9c41b-f581-4b5d-9014-4ba1e489517f', 'fb362c95-c728-41f8-971f-a6c17f9de35a', 'fc29770e-63f3-4477-a0ca-406cc8037e7f'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:45:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-fcbf36ef-ee86-4b67-9414-53e7d454cc31 tempest-VolumesCloneNegativeTest-120745050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-fcbf36ef-ee86-4b67-9414-53e7d454cc31 tempest-VolumesCloneNegativeTest-120745050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:49 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-fcbf36ef-ee86-4b67-9414-53e7d454cc31 tempest-VolumesCloneNegativeTest-120745050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:45:49 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-fcbf36ef-ee86-4b67-9414-53e7d454cc31 tempest-VolumesCloneNegativeTest-120745050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:45:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-fcbf36ef-ee86-4b67-9414-53e7d454cc31 tempest-VolumesCloneNegativeTest-120745050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-fcbf36ef-ee86-4b67-9414-53e7d454cc31 tempest-VolumesCloneNegativeTest-120745050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:49 devstack sudo[87611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:45:49 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:50 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-fcbf36ef-ee86-4b67-9414-53e7d454cc31 tempest-VolumesCloneNegativeTest-120745050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.497s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:50 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-fcbf36ef-ee86-4b67-9414-53e7d454cc31 tempest-VolumesCloneNegativeTest-120745050 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:45:50 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-fcbf36ef-ee86-4b67-9414-53e7d454cc31 tempest-VolumesCloneNegativeTest-120745050 None] Deleted volume successfully. Apr 16 19:45:50 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-fcbf36ef-ee86-4b67-9414-53e7d454cc31 tempest-VolumesCloneNegativeTest-120745050 None] Lock "cinder-02433a0c-0392-49e9-bf86-08cf2463118c-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:45:50 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-02aa032d-8278-43d3-8971-0d565404ff73 tempest-VolumesActionsTest-1008648987 None] Acquiring lock "cinder-7e36dfb4-435e-4bd3-bfce-76b1f77b0199-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:45:50 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-02aa032d-8278-43d3-8971-0d565404ff73 tempest-VolumesActionsTest-1008648987 None] Lock "cinder-7e36dfb4-435e-4bd3-bfce-76b1f77b0199-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:45:50 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-02aa032d-8278-43d3-8971-0d565404ff73 tempest-VolumesActionsTest-1008648987 None] Acquiring lock "cinder-quobyte-7e36dfb4-435e-4bd3-bfce-76b1f77b0199" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:45:50 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-02aa032d-8278-43d3-8971-0d565404ff73 tempest-VolumesActionsTest-1008648987 None] Lock "cinder-quobyte-7e36dfb4-435e-4bd3-bfce-76b1f77b0199" acquired by "delete_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:45:50 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[74aefbe5-c76f-4d28-946f-73f1a763545b]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:45:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-02aa032d-8278-43d3-8971-0d565404ff73 tempest-VolumesActionsTest-1008648987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7e36dfb4-435e-4bd3-bfce-76b1f77b0199 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:50 devstack sudo[87614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7e36dfb4-435e-4bd3-bfce-76b1f77b0199 Apr 16 19:45:50 devstack sudo[87614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:51 devstack sudo[87614]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-02aa032d-8278-43d3-8971-0d565404ff73 tempest-VolumesActionsTest-1008648987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7e36dfb4-435e-4bd3-bfce-76b1f77b0199" returned: 0 in 0.555s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-02aa032d-8278-43d3-8971-0d565404ff73 tempest-VolumesActionsTest-1008648987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7e36dfb4-435e-4bd3-bfce-76b1f77b0199 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:51 devstack sudo[87619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7e36dfb4-435e-4bd3-bfce-76b1f77b0199 Apr 16 19:45:51 devstack sudo[87619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:51 devstack sudo[87619]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-02aa032d-8278-43d3-8971-0d565404ff73 tempest-VolumesActionsTest-1008648987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7e36dfb4-435e-4bd3-bfce-76b1f77b0199" returned: 0 in 0.509s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:51 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-02aa032d-8278-43d3-8971-0d565404ff73 tempest-VolumesActionsTest-1008648987 None] Lock "cinder-quobyte-7e36dfb4-435e-4bd3-bfce-76b1f77b0199" released by "delete_volume" :: held 1.088s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:45:51 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-02aa032d-8278-43d3-8971-0d565404ff73 tempest-VolumesActionsTest-1008648987 None] Created reservations ['183c5528-5edd-4a0a-875b-13c84f23b9a5', '59b800f4-b4a9-4a50-a0af-bb0fe1dbc3f6', '0508fa43-397a-4b3d-8a2a-d9d005daab1a', 'd8ba33c5-2346-41c2-a0b0-454f8a18afd4'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:45:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-02aa032d-8278-43d3-8971-0d565404ff73 tempest-VolumesActionsTest-1008648987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-02aa032d-8278-43d3-8971-0d565404ff73 tempest-VolumesActionsTest-1008648987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:51 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-02aa032d-8278-43d3-8971-0d565404ff73 tempest-VolumesActionsTest-1008648987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:45:51 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-02aa032d-8278-43d3-8971-0d565404ff73 tempest-VolumesActionsTest-1008648987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:45:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-02aa032d-8278-43d3-8971-0d565404ff73 tempest-VolumesActionsTest-1008648987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-02aa032d-8278-43d3-8971-0d565404ff73 tempest-VolumesActionsTest-1008648987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:51 devstack sudo[87628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:45:51 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:52 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-02aa032d-8278-43d3-8971-0d565404ff73 tempest-VolumesActionsTest-1008648987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.459s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:52 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-02aa032d-8278-43d3-8971-0d565404ff73 tempest-VolumesActionsTest-1008648987 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:45:52 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-02aa032d-8278-43d3-8971-0d565404ff73 tempest-VolumesActionsTest-1008648987 None] Deleted volume successfully. Apr 16 19:45:52 devstack cinder-volume[82569]: DEBUG dbcounter [-] [82569] Writing DB stats cinder:UPDATE=134,cinder:SELECT=98,cinder:DELETE=5,cinder:INSERT=25 {{(pid=82569) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:45:52 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-02aa032d-8278-43d3-8971-0d565404ff73 tempest-VolumesActionsTest-1008648987 None] Lock "cinder-7e36dfb4-435e-4bd3-bfce-76b1f77b0199-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:45:53 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:45:53 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Flow 'volume_create_manager' (33d808a6-93d9-4665-bd13-0518368df3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:45:53 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddaca885-8fe9-4961-94bc-2a105610f2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:53 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddaca885-8fe9-4961-94bc-2a105610f2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-504666608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=336438aa-b8ef-4118-8082-06d04bc9e98f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe1b20afe9a94255b635797f7bbf0cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:45:53Z,use_quota=True,user_id='a5d192d1649e45509fc911c0586feb1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:53 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62bcb9c9-24b1-4b04-9fcc-b850b98831a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:53 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62bcb9c9-24b1-4b04-9fcc-b850b98831a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:53 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6ca2f1-ff76-423d-b466-105e33833cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:53 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6ca2f1-ff76-423d-b466-105e33833cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '336438aa-b8ef-4118-8082-06d04bc9e98f', 'volume_name': 'volume-336438aa-b8ef-4118-8082-06d04bc9e98f', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:53 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9550e0a-bcb0-4053-8d3a-9fc4a27489f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:53 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9550e0a-bcb0-4053-8d3a-9fc4a27489f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:53 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3daf0bb-f80f-4f49-935c-3dd843c8960d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:53 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Volume 336438aa-b8ef-4118-8082-06d04bc9e98f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-336438aa-b8ef-4118-8082-06d04bc9e98f', 'volume_size': 1} Apr 16 19:45:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:53 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-504666608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=336438aa-b8ef-4118-8082-06d04bc9e98f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe1b20afe9a94255b635797f7bbf0cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:45:53Z,use_quota=True,user_id='a5d192d1649e45509fc911c0586feb1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:45:53 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Creating volume 336438aa-b8ef-4118-8082-06d04bc9e98f {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:45:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:53 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:45:53 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:45:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:53 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:45:53 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:45:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-336438aa-b8ef-4118-8082-06d04bc9e98f 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:53 devstack sudo[87631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-336438aa-b8ef-4118-8082-06d04bc9e98f 1073741824 Apr 16 19:45:53 devstack sudo[87631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:53 devstack sudo[87631]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-336438aa-b8ef-4118-8082-06d04bc9e98f 1073741824" returned: 0 in 0.708s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-336438aa-b8ef-4118-8082-06d04bc9e98f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:53 devstack sudo[87637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-336438aa-b8ef-4118-8082-06d04bc9e98f Apr 16 19:45:53 devstack sudo[87637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Flow 'volume_create_manager' (6cd10bb5-1262-4c73-ace2-900094ab8065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8783bdd9-6fd7-4ea1-816f-4350482022be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8783bdd9-6fd7-4ea1-816f-4350482022be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2044070638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a62c08951534f5bb91a7dec624d17db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:45:54Z,use_quota=True,user_id='1d8df54eef6a4086b489e8cce7d4fd61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac6372b5-6a4c-4673-b593-ce2a4194c504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac6372b5-6a4c-4673-b593-ce2a4194c504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9cd80fd-a6b8-409d-a199-a59033df0680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9cd80fd-a6b8-409d-a199-a59033df0680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5', 'volume_name': 'volume-09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b820c2-eb4f-49a1-872f-06a77ffefd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b820c2-eb4f-49a1-872f-06a77ffefd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0444dfd-e690-4708-905f-43b8c1b121ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:54 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Volume 09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5', 'volume_size': 1} Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:54 devstack sudo[87637]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-336438aa-b8ef-4118-8082-06d04bc9e98f" returned: 0 in 0.537s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.175s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2044070638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a62c08951534f5bb91a7dec624d17db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:45:54Z,use_quota=True,user_id='1d8df54eef6a4086b489e8cce7d4fd61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Creating volume 09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:45:54 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3daf0bb-f80f-4f49-935c-3dd843c8960d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-336438aa-b8ef-4118-8082-06d04bc9e98f', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:54 devstack sudo[87640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5 1073741824 Apr 16 19:45:54 devstack sudo[87640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9547029e-fb54-4877-b60d-0c53d19a2ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:54 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Volume volume-336438aa-b8ef-4118-8082-06d04bc9e98f (336438aa-b8ef-4118-8082-06d04bc9e98f): created successfully Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9547029e-fb54-4877-b60d-0c53d19a2ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Flow 'volume_create_manager' (33d808a6-93d9-4665-bd13-0518368df3f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:45:54 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-c6c7ae5a-d329-4ddc-a801-e3b1f34d65ce tempest-VolumesActionsTest-676893848 None] Created volume successfully. Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:45:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Flow 'volume_create_manager' (79d2987c-1ddf-4bc8-bb15-277502cbd02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2049306-e3e2-4ebc-bce4-0610bb5ae5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2049306-e3e2-4ebc-bce4-0610bb5ae5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-351605262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e301dfd1-02b2-41f7-9a33-5190f210edcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940666f379854d18bb2d2b9821026a69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:45:55Z,use_quota=True,user_id='9ba85b08340d4d478343e27d2bb41037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32fa83ab-0d9c-48af-8d10-bbfca0347886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32fa83ab-0d9c-48af-8d10-bbfca0347886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (076bdb74-1364-45ec-b128-f4d7cfa6979d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (076bdb74-1364-45ec-b128-f4d7cfa6979d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e301dfd1-02b2-41f7-9a33-5190f210edcb', 'volume_name': 'volume-e301dfd1-02b2-41f7-9a33-5190f210edcb', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b262c14c-f485-4c85-bf4c-56101788903e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b262c14c-f485-4c85-bf4c-56101788903e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5dae9cf-42fe-44a2-9561-a8c7348017d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:55 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Volume e301dfd1-02b2-41f7-9a33-5190f210edcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e301dfd1-02b2-41f7-9a33-5190f210edcb', 'volume_size': 1} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:55 devstack sudo[87640]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5 1073741824" returned: 0 in 0.631s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:55 devstack sudo[87645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5 Apr 16 19:45:55 devstack sudo[87645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ff0604fa-6aa7-4d7a-9db8-36464d58d8ab tempest-VolumesActionsTest-1008648987 None] Acquiring lock "cinder-336438aa-b8ef-4118-8082-06d04bc9e98f-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ff0604fa-6aa7-4d7a-9db8-36464d58d8ab tempest-VolumesActionsTest-1008648987 None] Lock "cinder-336438aa-b8ef-4118-8082-06d04bc9e98f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ff0604fa-6aa7-4d7a-9db8-36464d58d8ab tempest-VolumesActionsTest-1008648987 None] Acquiring lock "cinder-quobyte-336438aa-b8ef-4118-8082-06d04bc9e98f" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ff0604fa-6aa7-4d7a-9db8-36464d58d8ab tempest-VolumesActionsTest-1008648987 None] Lock "cinder-quobyte-336438aa-b8ef-4118-8082-06d04bc9e98f" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b8ef4a-d5a6-4621-956b-c8c27388ab7b]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ff0604fa-6aa7-4d7a-9db8-36464d58d8ab tempest-VolumesActionsTest-1008648987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-336438aa-b8ef-4118-8082-06d04bc9e98f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:55 devstack sudo[87647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-336438aa-b8ef-4118-8082-06d04bc9e98f Apr 16 19:45:55 devstack sudo[87647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:55 devstack sudo[87645]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5" returned: 0 in 0.487s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.573s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-351605262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e301dfd1-02b2-41f7-9a33-5190f210edcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940666f379854d18bb2d2b9821026a69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:45:55Z,use_quota=True,user_id='9ba85b08340d4d478343e27d2bb41037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Creating volume e301dfd1-02b2-41f7-9a33-5190f210edcb {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:45:55 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0444dfd-e690-4708-905f-43b8c1b121ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:55 devstack sudo[87650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb 1073741824 Apr 16 19:45:55 devstack sudo[87650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751ac256-5591-48e5-b52f-335c4abc2aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:55 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Volume volume-09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5 (09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5): created successfully Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751ac256-5591-48e5-b52f-335c4abc2aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Flow 'volume_create_manager' (6cd10bb5-1262-4c73-ace2-900094ab8065) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:45:55 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-e9c6375e-0ebb-40b5-981f-2e1e659731b6 tempest-VolumesMetadataTest-1166837147 None] Created volume successfully. Apr 16 19:45:55 devstack sudo[87647]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ff0604fa-6aa7-4d7a-9db8-36464d58d8ab tempest-VolumesActionsTest-1008648987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-336438aa-b8ef-4118-8082-06d04bc9e98f" returned: 0 in 0.504s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ff0604fa-6aa7-4d7a-9db8-36464d58d8ab tempest-VolumesActionsTest-1008648987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-336438aa-b8ef-4118-8082-06d04bc9e98f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:55 devstack sudo[87655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-336438aa-b8ef-4118-8082-06d04bc9e98f Apr 16 19:45:55 devstack sudo[87655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:56 devstack sudo[87650]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb 1073741824" returned: 0 in 0.535s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:56 devstack sudo[87660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb Apr 16 19:45:56 devstack sudo[87660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:56 devstack sudo[87655]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ff0604fa-6aa7-4d7a-9db8-36464d58d8ab tempest-VolumesActionsTest-1008648987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-336438aa-b8ef-4118-8082-06d04bc9e98f" returned: 0 in 0.496s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:56 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ff0604fa-6aa7-4d7a-9db8-36464d58d8ab tempest-VolumesActionsTest-1008648987 None] Lock "cinder-quobyte-336438aa-b8ef-4118-8082-06d04bc9e98f" released by "delete_volume" :: held 1.037s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:45:56 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-ff0604fa-6aa7-4d7a-9db8-36464d58d8ab tempest-VolumesActionsTest-1008648987 None] Created reservations ['ef3f8707-648b-44a7-8eae-2cd942041f5f', 'f7b57fac-6c4f-4bfd-a8d5-7af686f50afc', 'f55a0eb9-5349-44ba-a3c8-90974dabae7f', '68f54dac-b2bf-4291-bde8-735861a93cd7'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:45:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ff0604fa-6aa7-4d7a-9db8-36464d58d8ab tempest-VolumesActionsTest-1008648987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ff0604fa-6aa7-4d7a-9db8-36464d58d8ab tempest-VolumesActionsTest-1008648987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:56 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ff0604fa-6aa7-4d7a-9db8-36464d58d8ab tempest-VolumesActionsTest-1008648987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:45:56 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ff0604fa-6aa7-4d7a-9db8-36464d58d8ab tempest-VolumesActionsTest-1008648987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:45:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ff0604fa-6aa7-4d7a-9db8-36464d58d8ab tempest-VolumesActionsTest-1008648987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ff0604fa-6aa7-4d7a-9db8-36464d58d8ab tempest-VolumesActionsTest-1008648987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:56 devstack sudo[87663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:45:56 devstack sudo[87663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:56 devstack sudo[87660]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb" returned: 0 in 0.552s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:56 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:45:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5dae9cf-42fe-44a2-9561-a8c7348017d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e301dfd1-02b2-41f7-9a33-5190f210edcb', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1bf8a3c-9e6c-48f4-8904-3fc5f42e5768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:56 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Volume volume-e301dfd1-02b2-41f7-9a33-5190f210edcb (e301dfd1-02b2-41f7-9a33-5190f210edcb): created successfully Apr 16 19:45:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1bf8a3c-9e6c-48f4-8904-3fc5f42e5768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Flow 'volume_create_manager' (79d2987c-1ddf-4bc8-bb15-277502cbd02d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:45:56 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-6006154a-bb5f-4c42-87d1-c6f01e80144f tempest-VolumesSnapshotListTestJSON-499410942 None] Created volume successfully. Apr 16 19:45:56 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-796e3ab0-4e1f-4168-b1d0-54575d96814c tempest-VolumesMetadataTest-1166837147 None] Acquiring lock "cinder-09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:45:56 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-796e3ab0-4e1f-4168-b1d0-54575d96814c tempest-VolumesMetadataTest-1166837147 None] Lock "cinder-09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:45:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-796e3ab0-4e1f-4168-b1d0-54575d96814c tempest-VolumesMetadataTest-1166837147 None] Acquiring lock "cinder-quobyte-09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:45:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-796e3ab0-4e1f-4168-b1d0-54575d96814c tempest-VolumesMetadataTest-1166837147 None] Lock "cinder-quobyte-09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5" acquired by "delete_volume" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:45:57 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[f173d3c4-5b6f-4d80-88fc-71377f55171b]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:45:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-796e3ab0-4e1f-4168-b1d0-54575d96814c tempest-VolumesMetadataTest-1166837147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:57 devstack sudo[87663]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ff0604fa-6aa7-4d7a-9db8-36464d58d8ab tempest-VolumesActionsTest-1008648987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.527s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:57 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-ff0604fa-6aa7-4d7a-9db8-36464d58d8ab tempest-VolumesActionsTest-1008648987 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:45:57 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-ff0604fa-6aa7-4d7a-9db8-36464d58d8ab tempest-VolumesActionsTest-1008648987 None] Deleted volume successfully. Apr 16 19:45:57 devstack sudo[87667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5 Apr 16 19:45:57 devstack sudo[87667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ff0604fa-6aa7-4d7a-9db8-36464d58d8ab tempest-VolumesActionsTest-1008648987 None] Lock "cinder-336438aa-b8ef-4118-8082-06d04bc9e98f-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:45:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-349f3704-83a1-4333-93f8-5a03f0902881 tempest-VolumesSnapshotListTestJSON-499410942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-349f3704-83a1-4333-93f8-5a03f0902881 tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:57 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-349f3704-83a1-4333-93f8-5a03f0902881 tempest-VolumesSnapshotListTestJSON-499410942 None] Creating offline snapshot c7f36bd9-19fd-4523-b95b-2d756752d632 of volume e301dfd1-02b2-41f7-9a33-5190f210edcb {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:45:57 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa2f2c2-573e-418e-a749-1587962fda7f]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:45:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-349f3704-83a1-4333-93f8-5a03f0902881 tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:57 devstack sudo[87669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb Apr 16 19:45:57 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:57 devstack sudo[87667]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-796e3ab0-4e1f-4168-b1d0-54575d96814c tempest-VolumesMetadataTest-1166837147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5" returned: 0 in 0.608s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-796e3ab0-4e1f-4168-b1d0-54575d96814c tempest-VolumesMetadataTest-1166837147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:57 devstack sudo[87674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5 Apr 16 19:45:57 devstack sudo[87674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:57 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-349f3704-83a1-4333-93f8-5a03f0902881 tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb" returned: 0 in 0.579s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-349f3704-83a1-4333-93f8-5a03f0902881 tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:57 devstack sudo[87679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632 1G Apr 16 19:45:57 devstack sudo[87679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:57 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:45:57 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Flow 'volume_create_manager' (b9f41fbf-ca7b-4198-b897-74afffbc9b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:45:57 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2da42eba-710c-46d2-ac79-76b14ecd5bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:57 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2da42eba-710c-46d2-ac79-76b14ecd5bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1275220452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5555757-29e9-4423-a4d3-f4252fcf54ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe1b20afe9a94255b635797f7bbf0cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:45:58Z,use_quota=True,user_id='a5d192d1649e45509fc911c0586feb1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:57 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc04efa-bfef-4ce9-bfc7-4824e260ebeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:57 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc04efa-bfef-4ce9-bfc7-4824e260ebeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:58 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e3d127-760e-439a-97ab-90ca8ed016ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:58 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e3d127-760e-439a-97ab-90ca8ed016ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5555757-29e9-4423-a4d3-f4252fcf54ba', 'volume_name': 'volume-c5555757-29e9-4423-a4d3-f4252fcf54ba', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:58 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fdf6a6b-71f6-4a36-9a02-78691f5cb891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:58 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fdf6a6b-71f6-4a36-9a02-78691f5cb891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:45:58 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58335ee5-23a7-4985-a410-4655271d4e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:45:58 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Volume c5555757-29e9-4423-a4d3-f4252fcf54ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5555757-29e9-4423-a4d3-f4252fcf54ba', 'volume_size': 1} Apr 16 19:45:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:58 devstack sudo[87674]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-796e3ab0-4e1f-4168-b1d0-54575d96814c tempest-VolumesMetadataTest-1166837147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5" returned: 0 in 0.506s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:58 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-796e3ab0-4e1f-4168-b1d0-54575d96814c tempest-VolumesMetadataTest-1166837147 None] Lock "cinder-quobyte-09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5" released by "delete_volume" :: held 1.134s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:45:58 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-796e3ab0-4e1f-4168-b1d0-54575d96814c tempest-VolumesMetadataTest-1166837147 None] Created reservations ['444a73ce-f20c-4a99-a3d1-2a56fd90fc44', '1c276192-a73a-4440-8d3c-b114c271042d', '675f77e2-aadd-4f90-a9bb-b7aa25714f4b', '3aa80332-931a-4f57-942d-92355fec816f'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:45:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-796e3ab0-4e1f-4168-b1d0-54575d96814c tempest-VolumesMetadataTest-1166837147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:45:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-796e3ab0-4e1f-4168-b1d0-54575d96814c tempest-VolumesMetadataTest-1166837147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:45:58 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-796e3ab0-4e1f-4168-b1d0-54575d96814c tempest-VolumesMetadataTest-1166837147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:45:58 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-796e3ab0-4e1f-4168-b1d0-54575d96814c tempest-VolumesMetadataTest-1166837147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:45:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-796e3ab0-4e1f-4168-b1d0-54575d96814c tempest-VolumesMetadataTest-1166837147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:45:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-796e3ab0-4e1f-4168-b1d0-54575d96814c tempest-VolumesMetadataTest-1166837147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:58 devstack sudo[87682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:45:58 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:58 devstack sudo[87679]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-349f3704-83a1-4333-93f8-5a03f0902881 tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632 1G" returned: 0 in 0.655s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-349f3704-83a1-4333-93f8-5a03f0902881 tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e301dfd1-02b2-41f7-9a33-5190f210edcb -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:58 devstack sudo[87687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e301dfd1-02b2-41f7-9a33-5190f210edcb -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632 Apr 16 19:45:58 devstack sudo[87687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:58 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-796e3ab0-4e1f-4168-b1d0-54575d96814c tempest-VolumesMetadataTest-1166837147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.518s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:58 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-796e3ab0-4e1f-4168-b1d0-54575d96814c tempest-VolumesMetadataTest-1166837147 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:45:58 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-796e3ab0-4e1f-4168-b1d0-54575d96814c tempest-VolumesMetadataTest-1166837147 None] Deleted volume successfully. Apr 16 19:45:58 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-796e3ab0-4e1f-4168-b1d0-54575d96814c tempest-VolumesMetadataTest-1166837147 None] Lock "cinder-09ed3040-9f2a-4d20-adc8-4eeb9bb3ffc5-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:45:59 devstack sudo[87687]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-349f3704-83a1-4333-93f8-5a03f0902881 tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e301dfd1-02b2-41f7-9a33-5190f210edcb -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632" returned: 0 in 0.560s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:59 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-349f3704-83a1-4333-93f8-5a03f0902881 tempest-VolumesSnapshotListTestJSON-499410942 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632 is being set with open permissions: ugo+rw Apr 16 19:45:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-349f3704-83a1-4333-93f8-5a03f0902881 tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:59 devstack sudo[87693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632 Apr 16 19:45:59 devstack sudo[87693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:45:59 devstack sudo[87693]: pam_unix(sudo:session): session closed for user root Apr 16 19:45:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-349f3704-83a1-4333-93f8-5a03f0902881 tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632" returned: 0 in 0.564s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:45:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-349f3704-83a1-4333-93f8-5a03f0902881 tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:45:59 devstack sudo[87697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.info Apr 16 19:45:59 devstack sudo[87697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:00 devstack sudo[87697]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-349f3704-83a1-4333-93f8-5a03f0902881 tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.info" returned: 0 in 0.477s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:00 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-349f3704-83a1-4333-93f8-5a03f0902881 tempest-VolumesSnapshotListTestJSON-499410942 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.info is being set with open permissions: ugo+rw Apr 16 19:46:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-349f3704-83a1-4333-93f8-5a03f0902881 tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:00 devstack sudo[87700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.info Apr 16 19:46:00 devstack sudo[87700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:00 devstack sudo[87700]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-349f3704-83a1-4333-93f8-5a03f0902881 tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.info" returned: 0 in 0.480s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-349f3704-83a1-4333-93f8-5a03f0902881 tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.395s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.632s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:00 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1275220452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5555757-29e9-4423-a4d3-f4252fcf54ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe1b20afe9a94255b635797f7bbf0cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:45:58Z,use_quota=True,user_id='a5d192d1649e45509fc911c0586feb1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:46:00 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Creating volume c5555757-29e9-4423-a4d3-f4252fcf54ba {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:46:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:00 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:00 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:00 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:46:00 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:46:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c5555757-29e9-4423-a4d3-f4252fcf54ba 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:00 devstack sudo[87703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c5555757-29e9-4423-a4d3-f4252fcf54ba 1073741824 Apr 16 19:46:00 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:00 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-349f3704-83a1-4333-93f8-5a03f0902881 tempest-VolumesSnapshotListTestJSON-499410942 None] Create snapshot completed successfully Apr 16 19:46:01 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c5555757-29e9-4423-a4d3-f4252fcf54ba 1073741824" returned: 0 in 0.585s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c5555757-29e9-4423-a4d3-f4252fcf54ba {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:01 devstack sudo[87708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c5555757-29e9-4423-a4d3-f4252fcf54ba Apr 16 19:46:01 devstack sudo[87708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-4ddf16ec-2f13-4acf-b6dd-634fa2da6a1e tempest-VolumesSnapshotListTestJSON-499410942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:01 devstack sudo[87708]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c5555757-29e9-4423-a4d3-f4252fcf54ba" returned: 0 in 0.624s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:01 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:46:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-4ddf16ec-2f13-4acf-b6dd-634fa2da6a1e tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.290s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:01 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-4ddf16ec-2f13-4acf-b6dd-634fa2da6a1e tempest-VolumesSnapshotListTestJSON-499410942 None] Creating offline snapshot 2f85088e-6e65-4447-a2d4-f0497151f46c of volume e301dfd1-02b2-41f7-9a33-5190f210edcb {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:46:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58335ee5-23a7-4985-a410-4655271d4e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5555757-29e9-4423-a4d3-f4252fcf54ba', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22cf346e-73fe-43ba-bea4-e175194cf20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:01 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[0503e4e3-e039-45e8-9dae-3cda654cd215]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-4ddf16ec-2f13-4acf-b6dd-634fa2da6a1e tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:01 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Volume volume-c5555757-29e9-4423-a4d3-f4252fcf54ba (c5555757-29e9-4423-a4d3-f4252fcf54ba): created successfully Apr 16 19:46:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22cf346e-73fe-43ba-bea4-e175194cf20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Flow 'volume_create_manager' (b9f41fbf-ca7b-4198-b897-74afffbc9b9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:02 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-fa2796eb-cd72-4e7a-a32f-c1b64a08cc17 tempest-VolumesActionsTest-676893848 None] Created volume successfully. Apr 16 19:46:02 devstack sudo[87711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632 Apr 16 19:46:02 devstack sudo[87711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:02 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:46:02 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Flow 'volume_create_manager' (ec9ea916-909d-442d-9202-d6d51b68cbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:02 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff2fef4-b8ed-464b-97b6-e55a2441fdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:02 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff2fef4-b8ed-464b-97b6-e55a2441fdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-966581113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46ca74f9-4b13-4635-aa78-0dc32eb12706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ab7abc95b5a406fa81ffe8e50a92e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:02Z,use_quota=True,user_id='16a7287372fb420cbeaf166bd7391257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:02 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e0c5f1-b4f6-4e06-8aa7-2c46cf933442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:02 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e0c5f1-b4f6-4e06-8aa7-2c46cf933442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:02 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75887e6b-8d47-428a-8ede-368f9993aab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:02 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75887e6b-8d47-428a-8ede-368f9993aab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46ca74f9-4b13-4635-aa78-0dc32eb12706', 'volume_name': 'volume-46ca74f9-4b13-4635-aa78-0dc32eb12706', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:02 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ed853c-19d2-484c-963c-725d5c546366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:02 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ed853c-19d2-484c-963c-725d5c546366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:02 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98677358-8435-4048-bce9-b695d622c04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:02 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Volume 46ca74f9-4b13-4635-aa78-0dc32eb12706: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46ca74f9-4b13-4635-aa78-0dc32eb12706', 'volume_size': 1} Apr 16 19:46:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:02 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-96b3783e-b108-44ce-b181-9cd9f6d48d3d tempest-VolumesActionsTest-1008648987 None] Acquiring lock "cinder-c5555757-29e9-4423-a4d3-f4252fcf54ba-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:02 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-96b3783e-b108-44ce-b181-9cd9f6d48d3d tempest-VolumesActionsTest-1008648987 None] Lock "cinder-c5555757-29e9-4423-a4d3-f4252fcf54ba-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:02 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-96b3783e-b108-44ce-b181-9cd9f6d48d3d tempest-VolumesActionsTest-1008648987 None] Acquiring lock "cinder-quobyte-c5555757-29e9-4423-a4d3-f4252fcf54ba" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:02 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-96b3783e-b108-44ce-b181-9cd9f6d48d3d tempest-VolumesActionsTest-1008648987 None] Lock "cinder-quobyte-c5555757-29e9-4423-a4d3-f4252fcf54ba" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:02 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a840be7-4645-467a-b508-2a808d23ac7a]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-96b3783e-b108-44ce-b181-9cd9f6d48d3d tempest-VolumesActionsTest-1008648987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c5555757-29e9-4423-a4d3-f4252fcf54ba {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:02 devstack sudo[87713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c5555757-29e9-4423-a4d3-f4252fcf54ba Apr 16 19:46:02 devstack sudo[87713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:02 devstack sudo[87711]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-4ddf16ec-2f13-4acf-b6dd-634fa2da6a1e tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632" returned: 0 in 0.608s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:02 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-4ddf16ec-2f13-4acf-b6dd-634fa2da6a1e tempest-VolumesSnapshotListTestJSON-499410942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e301dfd1-02b2-41f7-9a33-5190f210edcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:46:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-4ddf16ec-2f13-4acf-b6dd-634fa2da6a1e tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:02 devstack sudo[87718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c 1G Apr 16 19:46:02 devstack sudo[87718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:02 devstack sudo[87713]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-96b3783e-b108-44ce-b181-9cd9f6d48d3d tempest-VolumesActionsTest-1008648987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c5555757-29e9-4423-a4d3-f4252fcf54ba" returned: 0 in 0.502s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-96b3783e-b108-44ce-b181-9cd9f6d48d3d tempest-VolumesActionsTest-1008648987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c5555757-29e9-4423-a4d3-f4252fcf54ba {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:02 devstack sudo[87723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c5555757-29e9-4423-a4d3-f4252fcf54ba Apr 16 19:46:02 devstack sudo[87723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:03 devstack sudo[87718]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-4ddf16ec-2f13-4acf-b6dd-634fa2da6a1e tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c 1G" returned: 0 in 0.546s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-4ddf16ec-2f13-4acf-b6dd-634fa2da6a1e tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:03 devstack sudo[87728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c Apr 16 19:46:03 devstack sudo[87728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:03 devstack sudo[87723]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-96b3783e-b108-44ce-b181-9cd9f6d48d3d tempest-VolumesActionsTest-1008648987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c5555757-29e9-4423-a4d3-f4252fcf54ba" returned: 0 in 0.488s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:03 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-96b3783e-b108-44ce-b181-9cd9f6d48d3d tempest-VolumesActionsTest-1008648987 None] Lock "cinder-quobyte-c5555757-29e9-4423-a4d3-f4252fcf54ba" released by "delete_volume" :: held 1.023s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:03 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-96b3783e-b108-44ce-b181-9cd9f6d48d3d tempest-VolumesActionsTest-1008648987 None] Created reservations ['b8721b2a-7735-4e66-b05e-c518c8682d83', 'c088c2fb-4de6-4622-893e-0973bb56a9bc', '81dbc9aa-9ac0-4530-9e43-09f085a436fa', '4ff5f129-0e66-4851-9294-fd2101316b39'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:46:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-96b3783e-b108-44ce-b181-9cd9f6d48d3d tempest-VolumesActionsTest-1008648987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-96b3783e-b108-44ce-b181-9cd9f6d48d3d tempest-VolumesActionsTest-1008648987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:03 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-96b3783e-b108-44ce-b181-9cd9f6d48d3d tempest-VolumesActionsTest-1008648987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:03 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-96b3783e-b108-44ce-b181-9cd9f6d48d3d tempest-VolumesActionsTest-1008648987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-96b3783e-b108-44ce-b181-9cd9f6d48d3d tempest-VolumesActionsTest-1008648987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-96b3783e-b108-44ce-b181-9cd9f6d48d3d tempest-VolumesActionsTest-1008648987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:03 devstack sudo[87735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:46:03 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:03 devstack sudo[87728]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-4ddf16ec-2f13-4acf-b6dd-634fa2da6a1e tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c" returned: 0 in 0.504s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:03 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-4ddf16ec-2f13-4acf-b6dd-634fa2da6a1e tempest-VolumesSnapshotListTestJSON-499410942 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c is being set with open permissions: ugo+rw Apr 16 19:46:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-4ddf16ec-2f13-4acf-b6dd-634fa2da6a1e tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:03 devstack sudo[87737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c Apr 16 19:46:03 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:03 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-96b3783e-b108-44ce-b181-9cd9f6d48d3d tempest-VolumesActionsTest-1008648987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.448s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:03 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-96b3783e-b108-44ce-b181-9cd9f6d48d3d tempest-VolumesActionsTest-1008648987 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:46:03 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-96b3783e-b108-44ce-b181-9cd9f6d48d3d tempest-VolumesActionsTest-1008648987 None] Deleted volume successfully. Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-96b3783e-b108-44ce-b181-9cd9f6d48d3d tempest-VolumesActionsTest-1008648987 None] Lock "cinder-c5555757-29e9-4423-a4d3-f4252fcf54ba-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:04 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-4ddf16ec-2f13-4acf-b6dd-634fa2da6a1e tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c" returned: 0 in 0.421s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-4ddf16ec-2f13-4acf-b6dd-634fa2da6a1e tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.170s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.780s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-966581113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46ca74f9-4b13-4635-aa78-0dc32eb12706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ab7abc95b5a406fa81ffe8e50a92e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:02Z,use_quota=True,user_id='16a7287372fb420cbeaf166bd7391257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Creating volume 46ca74f9-4b13-4635-aa78-0dc32eb12706 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:46:04 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-46ca74f9-4b13-4635-aa78-0dc32eb12706 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG oslo_service.periodic_task [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82569) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:04 devstack sudo[87741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-46ca74f9-4b13-4635-aa78-0dc32eb12706 1073741824 Apr 16 19:46:04 devstack sudo[87741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:04 devstack sudo[87743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:46:04 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:04 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-4ddf16ec-2f13-4acf-b6dd-634fa2da6a1e tempest-VolumesSnapshotListTestJSON-499410942 None] Create snapshot completed successfully Apr 16 19:46:04 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.544s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:46:04 devstack sudo[87741]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-46ca74f9-4b13-4635-aa78-0dc32eb12706 1073741824" returned: 0 in 0.643s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-46ca74f9-4b13-4635-aa78-0dc32eb12706 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:04 devstack sudo[87749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-46ca74f9-4b13-4635-aa78-0dc32eb12706 Apr 16 19:46:04 devstack sudo[87749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Flow 'volume_create_manager' (6ce30650-3523-43dd-b783-8db8d5dd06d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f9bd549-7bf5-410b-943d-2e645ca0f75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b96efe79-87e6-407b-942f-e9272b09189f tempest-VolumesSnapshotListTestJSON-499410942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f9bd549-7bf5-410b-943d-2e645ca0f75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1414363840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75c0393-cefb-4a1a-a68e-1555ab278fd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe1b20afe9a94255b635797f7bbf0cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:05Z,use_quota=True,user_id='a5d192d1649e45509fc911c0586feb1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:04 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f9bcaf-11c6-45fd-9bfc-423c12acd2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:05 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f9bcaf-11c6-45fd-9bfc-423c12acd2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:05 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b258e5-97d7-4a91-8a1d-91d1c86327fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:05 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b258e5-97d7-4a91-8a1d-91d1c86327fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd75c0393-cefb-4a1a-a68e-1555ab278fd4', 'volume_name': 'volume-d75c0393-cefb-4a1a-a68e-1555ab278fd4', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:05 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2494eaca-2fe0-458f-8363-27492926eec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:05 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2494eaca-2fe0-458f-8363-27492926eec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:05 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8bad9e2-1bbc-412a-9f2e-2d71f19cd60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:05 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Volume d75c0393-cefb-4a1a-a68e-1555ab278fd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d75c0393-cefb-4a1a-a68e-1555ab278fd4', 'volume_size': 1} Apr 16 19:46:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:05 devstack sudo[87749]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-46ca74f9-4b13-4635-aa78-0dc32eb12706" returned: 0 in 0.478s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:05 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:46:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b96efe79-87e6-407b-942f-e9272b09189f tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.238s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:05 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-b96efe79-87e6-407b-942f-e9272b09189f tempest-VolumesSnapshotListTestJSON-499410942 None] Creating offline snapshot 8f65dcc9-79a6-46ee-b48f-6b27d123b2ab of volume e301dfd1-02b2-41f7-9a33-5190f210edcb {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:46:05 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98677358-8435-4048-bce9-b695d622c04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46ca74f9-4b13-4635-aa78-0dc32eb12706', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:05 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a307c447-0ace-4e49-a6c5-0ee451a60c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:05 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47ffcf2-8e8c-4749-a148-7374e815262e]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b96efe79-87e6-407b-942f-e9272b09189f tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:05 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Volume volume-46ca74f9-4b13-4635-aa78-0dc32eb12706 (46ca74f9-4b13-4635-aa78-0dc32eb12706): created successfully Apr 16 19:46:05 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a307c447-0ace-4e49-a6c5-0ee451a60c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:05 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Flow 'volume_create_manager' (ec9ea916-909d-442d-9202-d6d51b68cbef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:05 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-a79a7dc1-05a3-4b99-ac79-1511f61465fd tempest-VolumesTransfersV355Test-26228288 None] Created volume successfully. Apr 16 19:46:05 devstack sudo[87752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c Apr 16 19:46:05 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:05 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b96efe79-87e6-407b-942f-e9272b09189f tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c" returned: 0 in 0.556s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:05 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-b96efe79-87e6-407b-942f-e9272b09189f tempest-VolumesSnapshotListTestJSON-499410942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e301dfd1-02b2-41f7-9a33-5190f210edcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:46:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b96efe79-87e6-407b-942f-e9272b09189f tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.8f65dcc9-79a6-46ee-b48f-6b27d123b2ab 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:05 devstack sudo[87757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.8f65dcc9-79a6-46ee-b48f-6b27d123b2ab 1G Apr 16 19:46:05 devstack sudo[87757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:05 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-15117611-c307-44b3-9468-c95f4252a045 tempest-VolumesTransfersV355Test-763990401 None] Transfer volume completed successfully. Apr 16 19:46:06 devstack sudo[87757]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b96efe79-87e6-407b-942f-e9272b09189f tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.8f65dcc9-79a6-46ee-b48f-6b27d123b2ab 1G" returned: 0 in 0.509s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b96efe79-87e6-407b-942f-e9272b09189f tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.8f65dcc9-79a6-46ee-b48f-6b27d123b2ab {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:06 devstack sudo[87762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.8f65dcc9-79a6-46ee-b48f-6b27d123b2ab Apr 16 19:46:06 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:06 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c4810324-7974-49f1-b9cc-e76783edf1b6 tempest-VolumesTransfersV355Test-364860960 None] Acquiring lock "cinder-46ca74f9-4b13-4635-aa78-0dc32eb12706-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:06 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c4810324-7974-49f1-b9cc-e76783edf1b6 tempest-VolumesTransfersV355Test-364860960 None] Lock "cinder-46ca74f9-4b13-4635-aa78-0dc32eb12706-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:06 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c4810324-7974-49f1-b9cc-e76783edf1b6 tempest-VolumesTransfersV355Test-364860960 None] Acquiring lock "cinder-quobyte-46ca74f9-4b13-4635-aa78-0dc32eb12706" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:06 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c4810324-7974-49f1-b9cc-e76783edf1b6 tempest-VolumesTransfersV355Test-364860960 None] Lock "cinder-quobyte-46ca74f9-4b13-4635-aa78-0dc32eb12706" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:06 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[111b95fb-1cab-46f7-8fe7-14ea842372ec]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c4810324-7974-49f1-b9cc-e76783edf1b6 tempest-VolumesTransfersV355Test-364860960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-46ca74f9-4b13-4635-aa78-0dc32eb12706 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:06 devstack sudo[87767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-46ca74f9-4b13-4635-aa78-0dc32eb12706 Apr 16 19:46:06 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:06 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b96efe79-87e6-407b-942f-e9272b09189f tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.8f65dcc9-79a6-46ee-b48f-6b27d123b2ab" returned: 0 in 0.547s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:06 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-b96efe79-87e6-407b-942f-e9272b09189f tempest-VolumesSnapshotListTestJSON-499410942 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.8f65dcc9-79a6-46ee-b48f-6b27d123b2ab is being set with open permissions: ugo+rw Apr 16 19:46:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b96efe79-87e6-407b-942f-e9272b09189f tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.8f65dcc9-79a6-46ee-b48f-6b27d123b2ab {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:06 devstack sudo[87769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.8f65dcc9-79a6-46ee-b48f-6b27d123b2ab Apr 16 19:46:06 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:07 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c4810324-7974-49f1-b9cc-e76783edf1b6 tempest-VolumesTransfersV355Test-364860960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-46ca74f9-4b13-4635-aa78-0dc32eb12706" returned: 0 in 0.497s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c4810324-7974-49f1-b9cc-e76783edf1b6 tempest-VolumesTransfersV355Test-364860960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-46ca74f9-4b13-4635-aa78-0dc32eb12706 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:07 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b96efe79-87e6-407b-942f-e9272b09189f tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.8f65dcc9-79a6-46ee-b48f-6b27d123b2ab" returned: 0 in 0.430s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:07 devstack sudo[87775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-46ca74f9-4b13-4635-aa78-0dc32eb12706 Apr 16 19:46:07 devstack sudo[87775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b96efe79-87e6-407b-942f-e9272b09189f tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.109s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.326s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:07 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1414363840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75c0393-cefb-4a1a-a68e-1555ab278fd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe1b20afe9a94255b635797f7bbf0cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:05Z,use_quota=True,user_id='a5d192d1649e45509fc911c0586feb1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:46:07 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Creating volume d75c0393-cefb-4a1a-a68e-1555ab278fd4 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:46:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:07 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:07 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:07 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:46:07 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:46:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d75c0393-cefb-4a1a-a68e-1555ab278fd4 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:07 devstack sudo[87777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d75c0393-cefb-4a1a-a68e-1555ab278fd4 1073741824 Apr 16 19:46:07 devstack sudo[87777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:07 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-b96efe79-87e6-407b-942f-e9272b09189f tempest-VolumesSnapshotListTestJSON-499410942 None] Create snapshot completed successfully Apr 16 19:46:07 devstack sudo[87775]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c4810324-7974-49f1-b9cc-e76783edf1b6 tempest-VolumesTransfersV355Test-364860960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-46ca74f9-4b13-4635-aa78-0dc32eb12706" returned: 0 in 0.412s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:07 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c4810324-7974-49f1-b9cc-e76783edf1b6 tempest-VolumesTransfersV355Test-364860960 None] Lock "cinder-quobyte-46ca74f9-4b13-4635-aa78-0dc32eb12706" released by "delete_volume" :: held 0.948s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:07 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-c4810324-7974-49f1-b9cc-e76783edf1b6 tempest-VolumesTransfersV355Test-364860960 None] Created reservations ['4edaea9d-1737-49c6-b938-faa839567938', 'f90e7901-3f1a-4196-a7a7-aa2e9ca58291', 'bbbc1235-7035-4fd2-8859-edcf307c2c8f', '8dfcf669-7148-4f5d-b8bc-1846425d8e53'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:46:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-c4810324-7974-49f1-b9cc-e76783edf1b6 tempest-VolumesTransfersV355Test-364860960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-c4810324-7974-49f1-b9cc-e76783edf1b6 tempest-VolumesTransfersV355Test-364860960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:07 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-c4810324-7974-49f1-b9cc-e76783edf1b6 tempest-VolumesTransfersV355Test-364860960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:07 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-c4810324-7974-49f1-b9cc-e76783edf1b6 tempest-VolumesTransfersV355Test-364860960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-c4810324-7974-49f1-b9cc-e76783edf1b6 tempest-VolumesTransfersV355Test-364860960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c4810324-7974-49f1-b9cc-e76783edf1b6 tempest-VolumesTransfersV355Test-364860960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:07 devstack sudo[87783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:46:07 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:07 devstack sudo[87777]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d75c0393-cefb-4a1a-a68e-1555ab278fd4 1073741824" returned: 0 in 0.561s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d75c0393-cefb-4a1a-a68e-1555ab278fd4 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:07 devstack sudo[87785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d75c0393-cefb-4a1a-a68e-1555ab278fd4 Apr 16 19:46:07 devstack sudo[87785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Flow 'volume_create_manager' (eb3a9d57-d84c-4ce4-82e9-d8aa8f9f3eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c37bc2-2eb1-4538-b786-5c0a3158b72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c37bc2-2eb1-4538-b786-5c0a3158b72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1227447979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6154ba3a-c4f8-4e31-891b-10c343921a34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ab7abc95b5a406fa81ffe8e50a92e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:08Z,use_quota=True,user_id='16a7287372fb420cbeaf166bd7391257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c1fb849-e593-468f-9097-22c9f7dc117d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c1fb849-e593-468f-9097-22c9f7dc117d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187cccb8-5714-42c2-a22f-4d42409afa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187cccb8-5714-42c2-a22f-4d42409afa97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6154ba3a-c4f8-4e31-891b-10c343921a34', 'volume_name': 'volume-6154ba3a-c4f8-4e31-891b-10c343921a34', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:08 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd4dc88-429c-49ac-a1e7-8bb2ec33298f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd4dc88-429c-49ac-a1e7-8bb2ec33298f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba20306-f29e-432f-aad6-24e9fd2f8e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:08 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Volume 6154ba3a-c4f8-4e31-891b-10c343921a34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6154ba3a-c4f8-4e31-891b-10c343921a34', 'volume_size': 1} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c4810324-7974-49f1-b9cc-e76783edf1b6 tempest-VolumesTransfersV355Test-364860960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.546s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-c4810324-7974-49f1-b9cc-e76783edf1b6 tempest-VolumesTransfersV355Test-364860960 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:46:08 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-c4810324-7974-49f1-b9cc-e76783edf1b6 tempest-VolumesTransfersV355Test-364860960 None] Deleted volume successfully. Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c4810324-7974-49f1-b9cc-e76783edf1b6 tempest-VolumesTransfersV355Test-364860960 None] Lock "cinder-46ca74f9-4b13-4635-aa78-0dc32eb12706-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:08 devstack sudo[87785]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d75c0393-cefb-4a1a-a68e-1555ab278fd4" returned: 0 in 0.557s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.157s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1227447979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6154ba3a-c4f8-4e31-891b-10c343921a34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ab7abc95b5a406fa81ffe8e50a92e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:08Z,use_quota=True,user_id='16a7287372fb420cbeaf166bd7391257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Creating volume 6154ba3a-c4f8-4e31-891b-10c343921a34 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:46:08 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6154ba3a-c4f8-4e31-891b-10c343921a34 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8bad9e2-1bbc-412a-9f2e-2d71f19cd60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d75c0393-cefb-4a1a-a68e-1555ab278fd4', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a6a10a-24e7-4c19-a2fc-c18b0e213096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:08 devstack sudo[87789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6154ba3a-c4f8-4e31-891b-10c343921a34 1073741824 Apr 16 19:46:08 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:08 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Volume volume-d75c0393-cefb-4a1a-a68e-1555ab278fd4 (d75c0393-cefb-4a1a-a68e-1555ab278fd4): created successfully Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a6a10a-24e7-4c19-a2fc-c18b0e213096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Flow 'volume_create_manager' (6ce30650-3523-43dd-b783-8db8d5dd06d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:08 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-701bd16c-f79c-4fd0-965e-6a76ef3935f9 tempest-VolumesActionsTest-676893848 None] Created volume successfully. Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e336311f-b6f2-48ff-b320-9fa400110302 tempest-VolumesSnapshotListTestJSON-499410942 None] Acquiring lock "cinder-8f65dcc9-79a6-46ee-b48f-6b27d123b2ab-delete_snapshot" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e336311f-b6f2-48ff-b320-9fa400110302 tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "cinder-8f65dcc9-79a6-46ee-b48f-6b27d123b2ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e336311f-b6f2-48ff-b320-9fa400110302 tempest-VolumesSnapshotListTestJSON-499410942 None] Acquiring lock "cinder-quobyte-e301dfd1-02b2-41f7-9a33-5190f210edcb" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e336311f-b6f2-48ff-b320-9fa400110302 tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "cinder-quobyte-e301dfd1-02b2-41f7-9a33-5190f210edcb" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e336311f-b6f2-48ff-b320-9fa400110302 tempest-VolumesSnapshotListTestJSON-499410942 None] Acquiring lock "cinder-quobyte-8f65dcc9-79a6-46ee-b48f-6b27d123b2ab" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e336311f-b6f2-48ff-b320-9fa400110302 tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "cinder-quobyte-8f65dcc9-79a6-46ee-b48f-6b27d123b2ab" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-e336311f-b6f2-48ff-b320-9fa400110302 tempest-VolumesSnapshotListTestJSON-499410942 None] Deleting offline snapshot 8f65dcc9-79a6-46ee-b48f-6b27d123b2ab of volume e301dfd1-02b2-41f7-9a33-5190f210edcb {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-e336311f-b6f2-48ff-b320-9fa400110302 tempest-VolumesSnapshotListTestJSON-499410942 None] snapshot_file for this snap is: volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.8f65dcc9-79a6-46ee-b48f-6b27d123b2ab {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[c390b58a-f079-441e-a28d-17e887fd5701]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e336311f-b6f2-48ff-b320-9fa400110302 tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.8f65dcc9-79a6-46ee-b48f-6b27d123b2ab {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:08 devstack sudo[87791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.8f65dcc9-79a6-46ee-b48f-6b27d123b2ab Apr 16 19:46:08 devstack sudo[87791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:09 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6154ba3a-c4f8-4e31-891b-10c343921a34 1073741824" returned: 0 in 0.516s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6154ba3a-c4f8-4e31-891b-10c343921a34 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:09 devstack sudo[87796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6154ba3a-c4f8-4e31-891b-10c343921a34 Apr 16 19:46:09 devstack sudo[87796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:09 devstack sudo[87791]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e336311f-b6f2-48ff-b320-9fa400110302 tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.8f65dcc9-79a6-46ee-b48f-6b27d123b2ab" returned: 0 in 0.533s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:09 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-e336311f-b6f2-48ff-b320-9fa400110302 tempest-VolumesSnapshotListTestJSON-499410942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e301dfd1-02b2-41f7-9a33-5190f210edcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:46:09 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[5885bf31-77c8-4439-8d73-23f5b9f43b7c]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e336311f-b6f2-48ff-b320-9fa400110302 tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:09 devstack sudo[87803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c Apr 16 19:46:09 devstack sudo[87803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:09 devstack sudo[87796]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6154ba3a-c4f8-4e31-891b-10c343921a34" returned: 0 in 0.548s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:09 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:46:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba20306-f29e-432f-aad6-24e9fd2f8e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6154ba3a-c4f8-4e31-891b-10c343921a34', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d6ce98-e2cc-42dc-a012-2928b5f645fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:09 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Volume volume-6154ba3a-c4f8-4e31-891b-10c343921a34 (6154ba3a-c4f8-4e31-891b-10c343921a34): created successfully Apr 16 19:46:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d6ce98-e2cc-42dc-a012-2928b5f645fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Flow 'volume_create_manager' (eb3a9d57-d84c-4ce4-82e9-d8aa8f9f3eb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:09 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-2bee2aba-90a5-4870-b948-33c1d501edb4 tempest-VolumesTransfersV355Test-26228288 None] Created volume successfully. Apr 16 19:46:09 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-8c0fca8b-11a9-4d61-a0cf-d928f1210c41 tempest-VolumesActionsTest-676893848 None] Acquiring lock "cinder-d75c0393-cefb-4a1a-a68e-1555ab278fd4-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:09 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-8c0fca8b-11a9-4d61-a0cf-d928f1210c41 tempest-VolumesActionsTest-676893848 None] Lock "cinder-d75c0393-cefb-4a1a-a68e-1555ab278fd4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:09 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-8c0fca8b-11a9-4d61-a0cf-d928f1210c41 tempest-VolumesActionsTest-676893848 None] Acquiring lock "cinder-quobyte-d75c0393-cefb-4a1a-a68e-1555ab278fd4" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:09 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-8c0fca8b-11a9-4d61-a0cf-d928f1210c41 tempest-VolumesActionsTest-676893848 None] Lock "cinder-quobyte-d75c0393-cefb-4a1a-a68e-1555ab278fd4" acquired by "delete_volume" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:09 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[6471fffa-a6ba-4fe0-80fc-a21e9d4738fc]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8c0fca8b-11a9-4d61-a0cf-d928f1210c41 tempest-VolumesActionsTest-676893848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d75c0393-cefb-4a1a-a68e-1555ab278fd4 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:09 devstack sudo[87806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d75c0393-cefb-4a1a-a68e-1555ab278fd4 Apr 16 19:46:09 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:09 devstack sudo[87803]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e336311f-b6f2-48ff-b320-9fa400110302 tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c" returned: 0 in 0.555s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:09 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-e336311f-b6f2-48ff-b320-9fa400110302 tempest-VolumesSnapshotListTestJSON-499410942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e301dfd1-02b2-41f7-9a33-5190f210edcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:46:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e336311f-b6f2-48ff-b320-9fa400110302 tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.8f65dcc9-79a6-46ee-b48f-6b27d123b2ab {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:09 devstack sudo[87811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.8f65dcc9-79a6-46ee-b48f-6b27d123b2ab Apr 16 19:46:09 devstack sudo[87811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:10 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8c0fca8b-11a9-4d61-a0cf-d928f1210c41 tempest-VolumesActionsTest-676893848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d75c0393-cefb-4a1a-a68e-1555ab278fd4" returned: 0 in 0.532s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8c0fca8b-11a9-4d61-a0cf-d928f1210c41 tempest-VolumesActionsTest-676893848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d75c0393-cefb-4a1a-a68e-1555ab278fd4 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:10 devstack sudo[87819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d75c0393-cefb-4a1a-a68e-1555ab278fd4 Apr 16 19:46:10 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:10 devstack sudo[87811]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e336311f-b6f2-48ff-b320-9fa400110302 tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.8f65dcc9-79a6-46ee-b48f-6b27d123b2ab" returned: 0 in 0.572s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e336311f-b6f2-48ff-b320-9fa400110302 tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.8f65dcc9-79a6-46ee-b48f-6b27d123b2ab {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:10 devstack sudo[87821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.8f65dcc9-79a6-46ee-b48f-6b27d123b2ab Apr 16 19:46:10 devstack sudo[87821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:10 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-684622e9-2974-44b4-98a9-ae98d5abd757 tempest-VolumesTransfersV355Test-364860960 None] Acquiring lock "cinder-6154ba3a-c4f8-4e31-891b-10c343921a34-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:10 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-684622e9-2974-44b4-98a9-ae98d5abd757 tempest-VolumesTransfersV355Test-364860960 None] Lock "cinder-6154ba3a-c4f8-4e31-891b-10c343921a34-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:10 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-684622e9-2974-44b4-98a9-ae98d5abd757 tempest-VolumesTransfersV355Test-364860960 None] Acquiring lock "cinder-quobyte-6154ba3a-c4f8-4e31-891b-10c343921a34" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:10 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-684622e9-2974-44b4-98a9-ae98d5abd757 tempest-VolumesTransfersV355Test-364860960 None] Lock "cinder-quobyte-6154ba3a-c4f8-4e31-891b-10c343921a34" acquired by "delete_volume" :: waited 0.006s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:10 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ea1f99-b99a-4b34-8731-ee66392d455c]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-684622e9-2974-44b4-98a9-ae98d5abd757 tempest-VolumesTransfersV355Test-364860960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6154ba3a-c4f8-4e31-891b-10c343921a34 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:10 devstack sudo[87823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6154ba3a-c4f8-4e31-891b-10c343921a34 Apr 16 19:46:10 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:10 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8c0fca8b-11a9-4d61-a0cf-d928f1210c41 tempest-VolumesActionsTest-676893848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d75c0393-cefb-4a1a-a68e-1555ab278fd4" returned: 0 in 0.571s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:10 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-8c0fca8b-11a9-4d61-a0cf-d928f1210c41 tempest-VolumesActionsTest-676893848 None] Lock "cinder-quobyte-d75c0393-cefb-4a1a-a68e-1555ab278fd4" released by "delete_volume" :: held 1.138s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:10 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-8c0fca8b-11a9-4d61-a0cf-d928f1210c41 tempest-VolumesActionsTest-676893848 None] Created reservations ['33fbcdc5-f53e-423a-9839-5ae15a6b8831', '769ecead-ba98-436b-afca-2b23d4ffdbd5', 'ec105156-401e-4021-8d29-dc8108b26bf9', 'fb29d6f5-9cd1-47bc-96f4-be605f5dd01a'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-8c0fca8b-11a9-4d61-a0cf-d928f1210c41 tempest-VolumesActionsTest-676893848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-8c0fca8b-11a9-4d61-a0cf-d928f1210c41 tempest-VolumesActionsTest-676893848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-8c0fca8b-11a9-4d61-a0cf-d928f1210c41 tempest-VolumesActionsTest-676893848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-8c0fca8b-11a9-4d61-a0cf-d928f1210c41 tempest-VolumesActionsTest-676893848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-8c0fca8b-11a9-4d61-a0cf-d928f1210c41 tempest-VolumesActionsTest-676893848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8c0fca8b-11a9-4d61-a0cf-d928f1210c41 tempest-VolumesActionsTest-676893848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:11 devstack sudo[87821]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e336311f-b6f2-48ff-b320-9fa400110302 tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.8f65dcc9-79a6-46ee-b48f-6b27d123b2ab" returned: 0 in 0.542s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:11 devstack sudo[87827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:46:11 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e336311f-b6f2-48ff-b320-9fa400110302 tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "cinder-quobyte-8f65dcc9-79a6-46ee-b48f-6b27d123b2ab" released by "_delete_snapshot" :: held 2.260s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e336311f-b6f2-48ff-b320-9fa400110302 tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "cinder-quobyte-e301dfd1-02b2-41f7-9a33-5190f210edcb" released by "delete_snapshot" :: held 2.274s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-e336311f-b6f2-48ff-b320-9fa400110302 tempest-VolumesSnapshotListTestJSON-499410942 None] Created reservations ['d91d740d-5b63-43ea-a35c-a800569b43cd', '7bee5dda-9d37-4052-ad30-b5c1bad73991', '0484dd1c-fbbe-4e45-81e8-a27143d39a00', '263b280b-7d05-4b77-9d51-2eb21c0bb4ec'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:46:11 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-e336311f-b6f2-48ff-b320-9fa400110302 tempest-VolumesSnapshotListTestJSON-499410942 None] Delete snapshot completed successfully. Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e336311f-b6f2-48ff-b320-9fa400110302 tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "cinder-8f65dcc9-79a6-46ee-b48f-6b27d123b2ab-delete_snapshot" released by "delete_snapshot" :: held 2.382s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:11 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-684622e9-2974-44b4-98a9-ae98d5abd757 tempest-VolumesTransfersV355Test-364860960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6154ba3a-c4f8-4e31-891b-10c343921a34" returned: 0 in 0.601s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-684622e9-2974-44b4-98a9-ae98d5abd757 tempest-VolumesTransfersV355Test-364860960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6154ba3a-c4f8-4e31-891b-10c343921a34 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:11 devstack sudo[87864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6154ba3a-c4f8-4e31-891b-10c343921a34 Apr 16 19:46:11 devstack sudo[87864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:11 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8c0fca8b-11a9-4d61-a0cf-d928f1210c41 tempest-VolumesActionsTest-676893848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.508s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-8c0fca8b-11a9-4d61-a0cf-d928f1210c41 tempest-VolumesActionsTest-676893848 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:46:11 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-8c0fca8b-11a9-4d61-a0cf-d928f1210c41 tempest-VolumesActionsTest-676893848 None] Deleted volume successfully. Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-8c0fca8b-11a9-4d61-a0cf-d928f1210c41 tempest-VolumesActionsTest-676893848 None] Lock "cinder-d75c0393-cefb-4a1a-a68e-1555ab278fd4-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:11 devstack sudo[87864]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-684622e9-2974-44b4-98a9-ae98d5abd757 tempest-VolumesTransfersV355Test-364860960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6154ba3a-c4f8-4e31-891b-10c343921a34" returned: 0 in 0.474s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-684622e9-2974-44b4-98a9-ae98d5abd757 tempest-VolumesTransfersV355Test-364860960 None] Lock "cinder-quobyte-6154ba3a-c4f8-4e31-891b-10c343921a34" released by "delete_volume" :: held 1.104s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-684622e9-2974-44b4-98a9-ae98d5abd757 tempest-VolumesTransfersV355Test-364860960 None] Created reservations ['30a49e51-68f2-47dc-9f40-b2d4b222fe9d', '5a0cd09a-58ea-4945-ac8e-056ddfce28e6', '741603bd-ccbd-441a-9ea7-dbc03c3f09be', 'ebffdeff-4243-46de-b59d-a75b4ea0e361'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-684622e9-2974-44b4-98a9-ae98d5abd757 tempest-VolumesTransfersV355Test-364860960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-684622e9-2974-44b4-98a9-ae98d5abd757 tempest-VolumesTransfersV355Test-364860960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-684622e9-2974-44b4-98a9-ae98d5abd757 tempest-VolumesTransfersV355Test-364860960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-684622e9-2974-44b4-98a9-ae98d5abd757 tempest-VolumesTransfersV355Test-364860960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-684622e9-2974-44b4-98a9-ae98d5abd757 tempest-VolumesTransfersV355Test-364860960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-684622e9-2974-44b4-98a9-ae98d5abd757 tempest-VolumesTransfersV355Test-364860960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:11 devstack sudo[87870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:46:11 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-452c043b-909e-48f0-9757-0ddc32c3cd53 tempest-VolumesSnapshotListTestJSON-499410942 None] Acquiring lock "cinder-2f85088e-6e65-4447-a2d4-f0497151f46c-delete_snapshot" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-452c043b-909e-48f0-9757-0ddc32c3cd53 tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "cinder-2f85088e-6e65-4447-a2d4-f0497151f46c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-452c043b-909e-48f0-9757-0ddc32c3cd53 tempest-VolumesSnapshotListTestJSON-499410942 None] Acquiring lock "cinder-quobyte-e301dfd1-02b2-41f7-9a33-5190f210edcb" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-452c043b-909e-48f0-9757-0ddc32c3cd53 tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "cinder-quobyte-e301dfd1-02b2-41f7-9a33-5190f210edcb" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-452c043b-909e-48f0-9757-0ddc32c3cd53 tempest-VolumesSnapshotListTestJSON-499410942 None] Acquiring lock "cinder-quobyte-2f85088e-6e65-4447-a2d4-f0497151f46c" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-452c043b-909e-48f0-9757-0ddc32c3cd53 tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "cinder-quobyte-2f85088e-6e65-4447-a2d4-f0497151f46c" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-452c043b-909e-48f0-9757-0ddc32c3cd53 tempest-VolumesSnapshotListTestJSON-499410942 None] Deleting offline snapshot 2f85088e-6e65-4447-a2d4-f0497151f46c of volume e301dfd1-02b2-41f7-9a33-5190f210edcb {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-452c043b-909e-48f0-9757-0ddc32c3cd53 tempest-VolumesSnapshotListTestJSON-499410942 None] snapshot_file for this snap is: volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:46:11 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0ec0b0-9ce5-4ae8-8c56-fe4dbf6f9160]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-452c043b-909e-48f0-9757-0ddc32c3cd53 tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:12 devstack sudo[87872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c Apr 16 19:46:12 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:12 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-684622e9-2974-44b4-98a9-ae98d5abd757 tempest-VolumesTransfersV355Test-364860960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.512s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:12 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-684622e9-2974-44b4-98a9-ae98d5abd757 tempest-VolumesTransfersV355Test-364860960 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:46:12 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-684622e9-2974-44b4-98a9-ae98d5abd757 tempest-VolumesTransfersV355Test-364860960 None] Deleted volume successfully. Apr 16 19:46:12 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-684622e9-2974-44b4-98a9-ae98d5abd757 tempest-VolumesTransfersV355Test-364860960 None] Lock "cinder-6154ba3a-c4f8-4e31-891b-10c343921a34-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:12 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-452c043b-909e-48f0-9757-0ddc32c3cd53 tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c" returned: 0 in 0.579s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:12 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-452c043b-909e-48f0-9757-0ddc32c3cd53 tempest-VolumesSnapshotListTestJSON-499410942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e301dfd1-02b2-41f7-9a33-5190f210edcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:46:12 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fc8287-cb07-4de6-afda-455dd050ac1c]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-452c043b-909e-48f0-9757-0ddc32c3cd53 tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:12 devstack sudo[87878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632 Apr 16 19:46:12 devstack sudo[87878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:13 devstack sudo[87878]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-452c043b-909e-48f0-9757-0ddc32c3cd53 tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632" returned: 0 in 0.678s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:13 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-452c043b-909e-48f0-9757-0ddc32c3cd53 tempest-VolumesSnapshotListTestJSON-499410942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e301dfd1-02b2-41f7-9a33-5190f210edcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:46:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-452c043b-909e-48f0-9757-0ddc32c3cd53 tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:13 devstack sudo[87884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c Apr 16 19:46:13 devstack sudo[87884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:13 devstack sudo[87884]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-452c043b-909e-48f0-9757-0ddc32c3cd53 tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c" returned: 0 in 0.616s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-452c043b-909e-48f0-9757-0ddc32c3cd53 tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:13 devstack sudo[87890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c Apr 16 19:46:13 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:14 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-452c043b-909e-48f0-9757-0ddc32c3cd53 tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.2f85088e-6e65-4447-a2d4-f0497151f46c" returned: 0 in 0.525s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:14 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-452c043b-909e-48f0-9757-0ddc32c3cd53 tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "cinder-quobyte-2f85088e-6e65-4447-a2d4-f0497151f46c" released by "_delete_snapshot" :: held 2.468s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:14 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-452c043b-909e-48f0-9757-0ddc32c3cd53 tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "cinder-quobyte-e301dfd1-02b2-41f7-9a33-5190f210edcb" released by "delete_snapshot" :: held 2.483s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:14 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-452c043b-909e-48f0-9757-0ddc32c3cd53 tempest-VolumesSnapshotListTestJSON-499410942 None] Created reservations ['93025396-3859-4b43-9414-41080c29a051', 'cc67499a-5e45-423a-af21-f8091f34d374', '1a6f7dd3-d608-415b-84c1-a269b5582d42', '17939d74-16a5-4c0f-8849-7ba27049e0a4'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:46:14 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-452c043b-909e-48f0-9757-0ddc32c3cd53 tempest-VolumesSnapshotListTestJSON-499410942 None] Delete snapshot completed successfully. Apr 16 19:46:14 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-452c043b-909e-48f0-9757-0ddc32c3cd53 tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "cinder-2f85088e-6e65-4447-a2d4-f0497151f46c-delete_snapshot" released by "delete_snapshot" :: held 2.617s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:15 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-92cce383-f691-49b7-a318-1ca0a7707fdf tempest-VolumesSnapshotListTestJSON-499410942 None] Acquiring lock "cinder-c7f36bd9-19fd-4523-b95b-2d756752d632-delete_snapshot" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:15 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-92cce383-f691-49b7-a318-1ca0a7707fdf tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "cinder-c7f36bd9-19fd-4523-b95b-2d756752d632-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:15 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-92cce383-f691-49b7-a318-1ca0a7707fdf tempest-VolumesSnapshotListTestJSON-499410942 None] Acquiring lock "cinder-quobyte-e301dfd1-02b2-41f7-9a33-5190f210edcb" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:15 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-92cce383-f691-49b7-a318-1ca0a7707fdf tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "cinder-quobyte-e301dfd1-02b2-41f7-9a33-5190f210edcb" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:15 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-92cce383-f691-49b7-a318-1ca0a7707fdf tempest-VolumesSnapshotListTestJSON-499410942 None] Acquiring lock "cinder-quobyte-c7f36bd9-19fd-4523-b95b-2d756752d632" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:15 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-92cce383-f691-49b7-a318-1ca0a7707fdf tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "cinder-quobyte-c7f36bd9-19fd-4523-b95b-2d756752d632" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:15 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-92cce383-f691-49b7-a318-1ca0a7707fdf tempest-VolumesSnapshotListTestJSON-499410942 None] Deleting offline snapshot c7f36bd9-19fd-4523-b95b-2d756752d632 of volume e301dfd1-02b2-41f7-9a33-5190f210edcb {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:46:15 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-92cce383-f691-49b7-a318-1ca0a7707fdf tempest-VolumesSnapshotListTestJSON-499410942 None] snapshot_file for this snap is: volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:46:15 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27c0b19-c26d-4013-b033-eb09374afdcc]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-92cce383-f691-49b7-a318-1ca0a7707fdf tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:15 devstack sudo[87896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632 Apr 16 19:46:15 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:15 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-92cce383-f691-49b7-a318-1ca0a7707fdf tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632" returned: 0 in 0.663s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:15 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-92cce383-f691-49b7-a318-1ca0a7707fdf tempest-VolumesSnapshotListTestJSON-499410942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e301dfd1-02b2-41f7-9a33-5190f210edcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:46:15 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[c293b6c9-2376-4982-8289-7666a66a6f8b]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-92cce383-f691-49b7-a318-1ca0a7707fdf tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:15 devstack sudo[87901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb Apr 16 19:46:15 devstack sudo[87901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:16 devstack sudo[87901]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-92cce383-f691-49b7-a318-1ca0a7707fdf tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb" returned: 0 in 0.585s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-92cce383-f691-49b7-a318-1ca0a7707fdf tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:16 devstack sudo[87906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632 Apr 16 19:46:16 devstack sudo[87906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Flow 'volume_create_manager' (3d9878b7-3dcc-4080-a6f0-a3dd35d915ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cfd054a-300b-4c84-8741-9b744734b64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cfd054a-300b-4c84-8741-9b744734b64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-430053035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14f1bed253d44e918e17db7f97053d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:17Z,use_quota=True,user_id='c145cc7f2c354f2e84c50cd902cc67eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1852c097-9322-46a9-96f9-67f710bafae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1852c097-9322-46a9-96f9-67f710bafae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:17 devstack sudo[87906]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (198da67b-dbac-4121-8109-56aa66c3c0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (198da67b-dbac-4121-8109-56aa66c3c0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d', 'volume_name': 'volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a301cc2c-e862-41e7-8b84-9452d3062120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a301cc2c-e862-41e7-8b84-9452d3062120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c4654d-d3c5-4e2c-81cf-d38cb4c82a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:17 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Volume fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d', 'volume_size': 1} Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-430053035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14f1bed253d44e918e17db7f97053d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:17Z,use_quota=True,user_id='c145cc7f2c354f2e84c50cd902cc67eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Creating volume fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:46:17 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-92cce383-f691-49b7-a318-1ca0a7707fdf tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632" returned: 0 in 0.658s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-92cce383-f691-49b7-a318-1ca0a7707fdf tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:17 devstack sudo[87912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d 1073741824 Apr 16 19:46:17 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:17 devstack sudo[87913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632 Apr 16 19:46:17 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:17 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d 1073741824" returned: 0 in 0.597s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:17 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-92cce383-f691-49b7-a318-1ca0a7707fdf tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb.c7f36bd9-19fd-4523-b95b-2d756752d632" returned: 0 in 0.655s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:17 devstack sudo[87920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d Apr 16 19:46:17 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-92cce383-f691-49b7-a318-1ca0a7707fdf tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "cinder-quobyte-c7f36bd9-19fd-4523-b95b-2d756752d632" released by "_delete_snapshot" :: held 2.671s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-92cce383-f691-49b7-a318-1ca0a7707fdf tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "cinder-quobyte-e301dfd1-02b2-41f7-9a33-5190f210edcb" released by "delete_snapshot" :: held 2.702s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:17 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-92cce383-f691-49b7-a318-1ca0a7707fdf tempest-VolumesSnapshotListTestJSON-499410942 None] Created reservations ['e7b2f938-1569-45b5-88d7-bf5173aff7c7', '262068d9-a8dc-489d-9a27-6d1e68cd280d', '60155d18-b63d-4092-aeb7-10118aa96a17', '0538610c-164a-41f1-9f81-67db05e1d3db'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:46:18 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-92cce383-f691-49b7-a318-1ca0a7707fdf tempest-VolumesSnapshotListTestJSON-499410942 None] Delete snapshot completed successfully. Apr 16 19:46:18 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-92cce383-f691-49b7-a318-1ca0a7707fdf tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "cinder-c7f36bd9-19fd-4523-b95b-2d756752d632-delete_snapshot" released by "delete_snapshot" :: held 2.939s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:18 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b6127170-ac47-4147-be2b-adea2a09785e tempest-VolumesSnapshotListTestJSON-499410942 None] Acquiring lock "cinder-e301dfd1-02b2-41f7-9a33-5190f210edcb-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:18 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b6127170-ac47-4147-be2b-adea2a09785e tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "cinder-e301dfd1-02b2-41f7-9a33-5190f210edcb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:18 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d" returned: 0 in 0.629s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:18 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:46:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:18 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c4654d-d3c5-4e2c-81cf-d38cb4c82a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:18 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb91cd51-ea11-4738-b334-a02ef5a40c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:18 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Volume volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d (fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d): created successfully Apr 16 19:46:18 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb91cd51-ea11-4738-b334-a02ef5a40c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:18 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Flow 'volume_create_manager' (3d9878b7-3dcc-4080-a6f0-a3dd35d915ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:18 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b6127170-ac47-4147-be2b-adea2a09785e tempest-VolumesSnapshotListTestJSON-499410942 None] Acquiring lock "cinder-quobyte-e301dfd1-02b2-41f7-9a33-5190f210edcb" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:18 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-5182b14a-2b73-4464-b042-9ac700f5d208 tempest-VolumesCloneTest-1055162215 None] Created volume successfully. Apr 16 19:46:18 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b6127170-ac47-4147-be2b-adea2a09785e tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "cinder-quobyte-e301dfd1-02b2-41f7-9a33-5190f210edcb" acquired by "delete_volume" :: waited 0.023s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:18 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa137baa-40cd-4c4b-a4a0-7d8a953fb6de]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b6127170-ac47-4147-be2b-adea2a09785e tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:18 devstack sudo[87924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb Apr 16 19:46:18 devstack sudo[87924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:19 devstack sudo[87924]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b6127170-ac47-4147-be2b-adea2a09785e tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb" returned: 0 in 0.621s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b6127170-ac47-4147-be2b-adea2a09785e tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:19 devstack sudo[87929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb Apr 16 19:46:19 devstack sudo[87929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:19 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:46:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Flow 'volume_create_manager' (d59d88a2-34ea-405e-ba14-7947f31d1df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ba05ed-debc-4649-81aa-84469ec3b632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ba05ed-debc-4649-81aa-84469ec3b632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1291711339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3d6a0c4-470e-4d22-9a36-559b2bb2805c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14f1bed253d44e918e17db7f97053d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:19Z,use_quota=True,user_id='c145cc7f2c354f2e84c50cd902cc67eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46cbbd03-7567-4069-8d4b-af7b46a574a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46cbbd03-7567-4069-8d4b-af7b46a574a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6653f8f1-aca7-42de-b4ca-97621a516b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6653f8f1-aca7-42de-b4ca-97621a516b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd3d6a0c4-470e-4d22-9a36-559b2bb2805c', 'volume_name': 'volume-d3d6a0c4-470e-4d22-9a36-559b2bb2805c', 'volume_size': 2, 'source_volid': 'fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d', 'source_volstatus': 'available'}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7697725c-1331-473b-8613-777022e4013e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7697725c-1331-473b-8613-777022e4013e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e8d07e-dcb5-4069-be9f-7642c35015f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:19 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Volume d3d6a0c4-470e-4d22-9a36-559b2bb2805c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d3d6a0c4-470e-4d22-9a36-559b2bb2805c', 'volume_size': 2, 'source_volid': 'fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d', 'source_volstatus': 'available'} Apr 16 19:46:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:19 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Cloning volume fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d to volume d3d6a0c4-470e-4d22-9a36-559b2bb2805c Apr 16 19:46:19 devstack sudo[87929]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b6127170-ac47-4147-be2b-adea2a09785e tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e301dfd1-02b2-41f7-9a33-5190f210edcb" returned: 0 in 0.501s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:19 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b6127170-ac47-4147-be2b-adea2a09785e tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "cinder-quobyte-e301dfd1-02b2-41f7-9a33-5190f210edcb" released by "delete_volume" :: held 1.167s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:19 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Creating offline snapshot 411fe5d1-f13d-4a54-be0a-d1c87d303195 of volume fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:46:19 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[6993b06c-9e86-4ffd-84d3-cb79fb21153a]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:19 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-b6127170-ac47-4147-be2b-adea2a09785e tempest-VolumesSnapshotListTestJSON-499410942 None] Created reservations ['71a9ec46-7ce3-4d48-9fe3-576608b11302', '58ea0086-9a57-4138-9cfb-38e5f57c7288', 'cb528130-2460-4eba-aa80-2694d64f00d2', '1aecee0d-bb39-4653-8bd0-da7b38124a94'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:46:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b6127170-ac47-4147-be2b-adea2a09785e tempest-VolumesSnapshotListTestJSON-499410942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b6127170-ac47-4147-be2b-adea2a09785e tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:19 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-b6127170-ac47-4147-be2b-adea2a09785e tempest-VolumesSnapshotListTestJSON-499410942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:19 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-b6127170-ac47-4147-be2b-adea2a09785e tempest-VolumesSnapshotListTestJSON-499410942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b6127170-ac47-4147-be2b-adea2a09785e tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b6127170-ac47-4147-be2b-adea2a09785e tempest-VolumesSnapshotListTestJSON-499410942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:19 devstack sudo[87933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:46:19 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:19 devstack sudo[87932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d Apr 16 19:46:19 devstack sudo[87932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:20 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b6127170-ac47-4147-be2b-adea2a09785e tempest-VolumesSnapshotListTestJSON-499410942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.474s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:20 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-b6127170-ac47-4147-be2b-adea2a09785e tempest-VolumesSnapshotListTestJSON-499410942 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:46:20 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-b6127170-ac47-4147-be2b-adea2a09785e tempest-VolumesSnapshotListTestJSON-499410942 None] Deleted volume successfully. Apr 16 19:46:20 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b6127170-ac47-4147-be2b-adea2a09785e tempest-VolumesSnapshotListTestJSON-499410942 None] Lock "cinder-e301dfd1-02b2-41f7-9a33-5190f210edcb-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:20 devstack sudo[87932]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d" returned: 0 in 0.640s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.411fe5d1-f13d-4a54-be0a-d1c87d303195 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:20 devstack sudo[87940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.411fe5d1-f13d-4a54-be0a-d1c87d303195 1G Apr 16 19:46:20 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:21 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.411fe5d1-f13d-4a54-be0a-d1c87d303195 1G" returned: 0 in 0.766s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.411fe5d1-f13d-4a54-be0a-d1c87d303195 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:21 devstack sudo[87945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.411fe5d1-f13d-4a54-be0a-d1c87d303195 Apr 16 19:46:21 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.411fe5d1-f13d-4a54-be0a-d1c87d303195" returned: 0 in 0.523s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:21 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.411fe5d1-f13d-4a54-be0a-d1c87d303195 is being set with open permissions: ugo+rw Apr 16 19:46:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.411fe5d1-f13d-4a54-be0a-d1c87d303195 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:21 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:21 devstack sudo[87950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.411fe5d1-f13d-4a54-be0a-d1c87d303195 Apr 16 19:46:21 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:21 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:46:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Flow 'volume_create_manager' (76a0eaea-5e39-408d-9f65-da8f15d2c2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6dcc9f-b3e9-4c16-aef5-9a86e0a58a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6dcc9f-b3e9-4c16-aef5-9a86e0a58a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1284924445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87922a12-2b34-4317-be59-e44010cc7f86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea8b89d83c44144ac02e09f9342e735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:22Z,use_quota=True,user_id='0f5427e560c14c92b5bd927c2dc6b27d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e92cdc2-a415-4bc7-b854-9a0fbe65ffd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e92cdc2-a415-4bc7-b854-9a0fbe65ffd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bece0bfd-d668-4571-8400-5c50257afa9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bece0bfd-d668-4571-8400-5c50257afa9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87922a12-2b34-4317-be59-e44010cc7f86', 'volume_name': 'volume-87922a12-2b34-4317-be59-e44010cc7f86', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd8c3ce-7eb5-434e-b365-2182ca120073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd8c3ce-7eb5-434e-b365-2182ca120073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9874c74-b992-4cc0-a1cd-83286d14c9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:22 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Volume 87922a12-2b34-4317-be59-e44010cc7f86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87922a12-2b34-4317-be59-e44010cc7f86', 'volume_size': 1} Apr 16 19:46:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:22 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.411fe5d1-f13d-4a54-be0a-d1c87d303195" returned: 0 in 0.509s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:22 devstack sudo[87953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.info Apr 16 19:46:22 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:22 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.info" returned: 0 in 0.449s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:22 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.info is being set with open permissions: ugo+rw Apr 16 19:46:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:22 devstack sudo[87956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.info Apr 16 19:46:22 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:22 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:46:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Flow 'volume_create_manager' (f74071b8-0124-40c3-bbc4-7335e7eb99bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb3279e-d522-45c2-b7f6-dff84e38bfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb3279e-d522-45c2-b7f6-dff84e38bfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1617862879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f62087a-03f1-40fe-97c5-ea1d47cfb5d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4dfec79959405fb52b5351e94bb00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:23Z,use_quota=True,user_id='5bd713ed454b4ad7b5ff403a339484e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d7b193-e74f-45a1-aeb0-06d774513077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d7b193-e74f-45a1-aeb0-06d774513077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2427752d-17b4-476d-84a7-7151ee2b93d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2427752d-17b4-476d-84a7-7151ee2b93d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f62087a-03f1-40fe-97c5-ea1d47cfb5d2', 'volume_name': 'volume-5f62087a-03f1-40fe-97c5-ea1d47cfb5d2', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07085d6a-3d94-4112-ab01-6c7f0a10f331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07085d6a-3d94-4112-ab01-6c7f0a10f331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369bb0c1-7ed8-47fb-abe8-0570b8a4abc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:22 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Volume 5f62087a-03f1-40fe-97c5-ea1d47cfb5d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f62087a-03f1-40fe-97c5-ea1d47cfb5d2', 'volume_size': 1} Apr 16 19:46:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:22 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Flow 'volume_create_manager' (2338bc38-f089-4d21-abe6-4d8548eba5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2422cf17-5205-411f-a12e-666207ead294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2422cf17-5205-411f-a12e-666207ead294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1913881593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f74da6f8-2c60-448d-b351-500fccd4c12a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4dfec79959405fb52b5351e94bb00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:23Z,use_quota=True,user_id='5bd713ed454b4ad7b5ff403a339484e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:23 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (063c1b13-eaf3-467e-9354-f5e31abed74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (063c1b13-eaf3-467e-9354-f5e31abed74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e548684-c521-4024-afb6-5f943d47dbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e548684-c521-4024-afb6-5f943d47dbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f74da6f8-2c60-448d-b351-500fccd4c12a', 'volume_name': 'volume-f74da6f8-2c60-448d-b351-500fccd4c12a', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ac7fce-74df-4649-9c96-7f83b49fe946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ac7fce-74df-4649-9c96-7f83b49fe946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a81768-5c31-4015-87c1-19cb887f97fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:23 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Volume f74da6f8-2c60-448d-b351-500fccd4c12a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f74da6f8-2c60-448d-b351-500fccd4c12a', 'volume_size': 1} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.info" returned: 0 in 0.562s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Acquiring lock "cinder-quobyte-d3d6a0c4-470e-4d22-9a36-559b2bb2805c" by "_copy_volume_from_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Lock "cinder-quobyte-d3d6a0c4-470e-4d22-9a36-559b2bb2805c" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] snapshot: 411fe5d1-f13d-4a54-be0a-d1c87d303195, volume: d3d6a0c4-470e-4d22-9a36-559b2bb2805c, {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c453d13-41ae-49f7-9ff2-42bb3c7e7749]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.411fe5d1-f13d-4a54-be0a-d1c87d303195 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:23 devstack sudo[87959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.411fe5d1-f13d-4a54-be0a-d1c87d303195 Apr 16 19:46:23 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Flow 'volume_create_manager' (8a153fe4-d20e-489b-a313-aec12aac2cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d3677f-b65f-46ed-88d8-1c7c1fb0e61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d3677f-b65f-46ed-88d8-1c7c1fb0e61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1621887829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5902243-65a8-4545-85e5-1c13d4e392eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4dfec79959405fb52b5351e94bb00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:23Z,use_quota=True,user_id='5bd713ed454b4ad7b5ff403a339484e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0243096-cd05-40b7-8fa0-36dca3d1a05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0243096-cd05-40b7-8fa0-36dca3d1a05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533f52ec-b59b-41b3-a503-1ea9d3ac70bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533f52ec-b59b-41b3-a503-1ea9d3ac70bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5902243-65a8-4545-85e5-1c13d4e392eb', 'volume_name': 'volume-f5902243-65a8-4545-85e5-1c13d4e392eb', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbebb1af-ee2b-406f-a8cf-55b402f2a9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbebb1af-ee2b-406f-a8cf-55b402f2a9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38fc9883-5db1-4687-858d-835622f6d9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:23 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Volume f5902243-65a8-4545-85e5-1c13d4e392eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5902243-65a8-4545-85e5-1c13d4e392eb', 'volume_size': 1} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Flow 'volume_create_manager' (562a9b60-3bcb-40a0-b19a-56e79fdafad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3577160f-a4a6-4fbd-9b18-a70b57f1ca78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3577160f-a4a6-4fbd-9b18-a70b57f1ca78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-313249110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c9738b8-a038-47bc-938d-e07737c03cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4dfec79959405fb52b5351e94bb00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:23Z,use_quota=True,user_id='5bd713ed454b4ad7b5ff403a339484e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c94888-a67d-4dd1-8050-6645b920e914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c94888-a67d-4dd1-8050-6645b920e914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6001087-51c5-4d82-b546-6c1712bcec63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6001087-51c5-4d82-b546-6c1712bcec63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c9738b8-a038-47bc-938d-e07737c03cdf', 'volume_name': 'volume-3c9738b8-a038-47bc-938d-e07737c03cdf', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc83f0b2-e8f7-470a-9627-b147726cb568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc83f0b2-e8f7-470a-9627-b147726cb568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68cd2609-4c53-4c1e-aa6a-b9a0b94efc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:23 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Volume 3c9738b8-a038-47bc-938d-e07737c03cdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c9738b8-a038-47bc-938d-e07737c03cdf', 'volume_size': 1} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Flow 'volume_create_manager' (0009bf2e-0201-459c-a104-009633325ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8acc08a-c37c-4c46-bc52-cbb854cccf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8acc08a-c37c-4c46-bc52-cbb854cccf7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-905883300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f383d3f3-e3c6-4eea-98df-72ef784a6404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4dfec79959405fb52b5351e94bb00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:24Z,use_quota=True,user_id='5bd713ed454b4ad7b5ff403a339484e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe385ea5-46fd-423a-8e98-f0d7bb6ad180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe385ea5-46fd-423a-8e98-f0d7bb6ad180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19bfccf-237c-4f96-8ad3-a53f06848b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19bfccf-237c-4f96-8ad3-a53f06848b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f383d3f3-e3c6-4eea-98df-72ef784a6404', 'volume_name': 'volume-f383d3f3-e3c6-4eea-98df-72ef784a6404', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944a3a3e-cf4f-4322-ab7f-725c64e5d417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944a3a3e-cf4f-4322-ab7f-725c64e5d417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:23 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ef0936-0e6a-4e92-b401-5723423abb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:23 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Volume f383d3f3-e3c6-4eea-98df-72ef784a6404: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f383d3f3-e3c6-4eea-98df-72ef784a6404', 'volume_size': 1} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.411fe5d1-f13d-4a54-be0a-d1c87d303195" returned: 0 in 0.612s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Creating direct copy from snapshot {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bc8eeb-db6e-49f4-bf0c-7b15ad27c6a1]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:23 devstack sudo[87965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d Apr 16 19:46:23 devstack sudo[87965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:24 devstack sudo[87965]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d" returned: 0 in 0.482s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:24 devstack cinder-volume[82569]: DEBUG cinder.utils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Path /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d3d6a0c4-470e-4d22-9a36-559b2bb2805c not found in is_blk_device check {{(pid=82569) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 19:46:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d3d6a0c4-470e-4d22-9a36-559b2bb2805c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:24 devstack sudo[87970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d3d6a0c4-470e-4d22-9a36-559b2bb2805c Apr 16 19:46:24 devstack sudo[87970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:26 devstack sudo[87970]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d3d6a0c4-470e-4d22-9a36-559b2bb2805c" returned: 0 in 2.380s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:26 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a1c37e-27a1-48ed-9e5a-769090507d84]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:26 devstack sudo[87982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d Apr 16 19:46:26 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:27 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d" returned: 0 in 0.614s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:27 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Image conversion details: src /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d, size 1024.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d3d6a0c4-470e-4d22-9a36-559b2bb2805c {{(pid=82569) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 19:46:27 devstack cinder-volume[82569]: INFO cinder.image.image_utils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Converted 1024.00 MB image at 429.99 MB/s Apr 16 19:46:27 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d3d6a0c4-470e-4d22-9a36-559b2bb2805c is being set with open permissions: ugo+rw Apr 16 19:46:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d3d6a0c4-470e-4d22-9a36-559b2bb2805c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:27 devstack sudo[87987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d3d6a0c4-470e-4d22-9a36-559b2bb2805c Apr 16 19:46:27 devstack sudo[87987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:27 devstack sudo[87987]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d3d6a0c4-470e-4d22-9a36-559b2bb2805c" returned: 0 in 0.444s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:27 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Lock "cinder-quobyte-d3d6a0c4-470e-4d22-9a36-559b2bb2805c" released by "_copy_volume_from_snapshot" :: held 4.593s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:27 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Acquiring lock "cinder-quobyte-411fe5d1-f13d-4a54-be0a-d1c87d303195" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:27 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Lock "cinder-quobyte-411fe5d1-f13d-4a54-be0a-d1c87d303195" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:27 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Deleting offline snapshot 411fe5d1-f13d-4a54-be0a-d1c87d303195 of volume fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:46:27 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] snapshot_file for this snap is: volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.411fe5d1-f13d-4a54-be0a-d1c87d303195 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:46:27 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fbd91e-7403-4021-8615-139928de8d28]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.411fe5d1-f13d-4a54-be0a-d1c87d303195 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:27 devstack sudo[87990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.411fe5d1-f13d-4a54-be0a-d1c87d303195 Apr 16 19:46:27 devstack sudo[87990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:28 devstack sudo[87990]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.411fe5d1-f13d-4a54-be0a-d1c87d303195" returned: 0 in 0.554s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:28 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:46:28 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c6f279-2706-4dc0-bb87-eaabcaef3032]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:28 devstack sudo[87995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d Apr 16 19:46:28 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:28 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d" returned: 0 in 0.548s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.411fe5d1-f13d-4a54-be0a-d1c87d303195 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:28 devstack sudo[88000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.411fe5d1-f13d-4a54-be0a-d1c87d303195 Apr 16 19:46:28 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:29 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.411fe5d1-f13d-4a54-be0a-d1c87d303195" returned: 0 in 0.457s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.411fe5d1-f13d-4a54-be0a-d1c87d303195 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:29 devstack sudo[88005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.411fe5d1-f13d-4a54-be0a-d1c87d303195 Apr 16 19:46:29 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:29 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d.411fe5d1-f13d-4a54-be0a-d1c87d303195" returned: 0 in 0.456s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:29 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Lock "cinder-quobyte-411fe5d1-f13d-4a54-be0a-d1c87d303195" released by "_delete_snapshot" :: held 2.070s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.249s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.780s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1284924445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87922a12-2b34-4317-be59-e44010cc7f86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea8b89d83c44144ac02e09f9342e735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:22Z,use_quota=True,user_id='0f5427e560c14c92b5bd927c2dc6b27d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:46:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Creating volume 87922a12-2b34-4317-be59-e44010cc7f86 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:46:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:46:29 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:46:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-87922a12-2b34-4317-be59-e44010cc7f86 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:29 devstack sudo[88008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-87922a12-2b34-4317-be59-e44010cc7f86 1073741824 Apr 16 19:46:29 devstack sudo[88008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e8d07e-dcb5-4069-be9f-7642c35015f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3d6a0c4-470e-4d22-9a36-559b2bb2805c', 'volume_size': 2, 'source_volid': 'fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d', 'source_volstatus': 'available'}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c669610d-2043-4f03-9d4a-285d598798a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:29 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Volume volume-d3d6a0c4-470e-4d22-9a36-559b2bb2805c (d3d6a0c4-470e-4d22-9a36-559b2bb2805c): created successfully Apr 16 19:46:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c669610d-2043-4f03-9d4a-285d598798a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Flow 'volume_create_manager' (d59d88a2-34ea-405e-ba14-7947f31d1df4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:29 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-3ebabb86-b327-487a-8e66-6986058215af tempest-VolumesCloneTest-1055162215 None] Created volume successfully. Apr 16 19:46:30 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1ceca9ff-2077-4452-b8f8-f8bd6aa35329 tempest-VolumesCloneTest-1055162215 None] Acquiring lock "cinder-d3d6a0c4-470e-4d22-9a36-559b2bb2805c-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:30 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1ceca9ff-2077-4452-b8f8-f8bd6aa35329 tempest-VolumesCloneTest-1055162215 None] Lock "cinder-d3d6a0c4-470e-4d22-9a36-559b2bb2805c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:30 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1ceca9ff-2077-4452-b8f8-f8bd6aa35329 tempest-VolumesCloneTest-1055162215 None] Acquiring lock "cinder-quobyte-d3d6a0c4-470e-4d22-9a36-559b2bb2805c" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:30 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1ceca9ff-2077-4452-b8f8-f8bd6aa35329 tempest-VolumesCloneTest-1055162215 None] Lock "cinder-quobyte-d3d6a0c4-470e-4d22-9a36-559b2bb2805c" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:30 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac60b4aa-2e68-42ca-86be-67dd546b5348]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1ceca9ff-2077-4452-b8f8-f8bd6aa35329 tempest-VolumesCloneTest-1055162215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d3d6a0c4-470e-4d22-9a36-559b2bb2805c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:30 devstack sudo[88008]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-87922a12-2b34-4317-be59-e44010cc7f86 1073741824" returned: 0 in 0.550s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-87922a12-2b34-4317-be59-e44010cc7f86 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:30 devstack sudo[88013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d3d6a0c4-470e-4d22-9a36-559b2bb2805c Apr 16 19:46:30 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:30 devstack sudo[88014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-87922a12-2b34-4317-be59-e44010cc7f86 Apr 16 19:46:30 devstack sudo[88014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:30 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1ceca9ff-2077-4452-b8f8-f8bd6aa35329 tempest-VolumesCloneTest-1055162215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d3d6a0c4-470e-4d22-9a36-559b2bb2805c" returned: 0 in 0.502s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1ceca9ff-2077-4452-b8f8-f8bd6aa35329 tempest-VolumesCloneTest-1055162215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d3d6a0c4-470e-4d22-9a36-559b2bb2805c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:30 devstack sudo[88014]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-87922a12-2b34-4317-be59-e44010cc7f86" returned: 0 in 0.462s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:46:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:30 devstack sudo[88021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d3d6a0c4-470e-4d22-9a36-559b2bb2805c Apr 16 19:46:30 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1617862879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f62087a-03f1-40fe-97c5-ea1d47cfb5d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4dfec79959405fb52b5351e94bb00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:23Z,use_quota=True,user_id='5bd713ed454b4ad7b5ff403a339484e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:46:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Creating volume 5f62087a-03f1-40fe-97c5-ea1d47cfb5d2 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:46:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:46:30 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:46:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-5f62087a-03f1-40fe-97c5-ea1d47cfb5d2 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9874c74-b992-4cc0-a1cd-83286d14c9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87922a12-2b34-4317-be59-e44010cc7f86', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:30 devstack sudo[88023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-5f62087a-03f1-40fe-97c5-ea1d47cfb5d2 1073741824 Apr 16 19:46:30 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf29609-4013-4a53-9f54-867bfb377ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:30 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Volume volume-87922a12-2b34-4317-be59-e44010cc7f86 (87922a12-2b34-4317-be59-e44010cc7f86): created successfully Apr 16 19:46:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf29609-4013-4a53-9f54-867bfb377ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Flow 'volume_create_manager' (76a0eaea-5e39-408d-9f65-da8f15d2c2c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:30 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-2cc631d1-76a7-4edc-a712-a7ecdf6532b7 tempest-VolumesListAdminTestJSON-1529682493 None] Created volume successfully. Apr 16 19:46:31 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1ceca9ff-2077-4452-b8f8-f8bd6aa35329 tempest-VolumesCloneTest-1055162215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d3d6a0c4-470e-4d22-9a36-559b2bb2805c" returned: 0 in 0.487s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:31 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1ceca9ff-2077-4452-b8f8-f8bd6aa35329 tempest-VolumesCloneTest-1055162215 None] Lock "cinder-quobyte-d3d6a0c4-470e-4d22-9a36-559b2bb2805c" released by "delete_volume" :: held 1.013s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:31 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-1ceca9ff-2077-4452-b8f8-f8bd6aa35329 tempest-VolumesCloneTest-1055162215 None] Created reservations ['8b789f7f-201c-4dbd-8231-46b7434412ea', '6f73fc8e-9e90-4af6-8b2b-139a83841d0d', 'e9a2001c-5df8-408d-b0b7-631a1fcbbd97', 'a5cb3d57-df8b-4d4b-b891-1746cc80ade4'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:46:31 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-5f62087a-03f1-40fe-97c5-ea1d47cfb5d2 1073741824" returned: 0 in 0.588s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1ceca9ff-2077-4452-b8f8-f8bd6aa35329 tempest-VolumesCloneTest-1055162215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1ceca9ff-2077-4452-b8f8-f8bd6aa35329 tempest-VolumesCloneTest-1055162215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:31 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1ceca9ff-2077-4452-b8f8-f8bd6aa35329 tempest-VolumesCloneTest-1055162215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:31 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1ceca9ff-2077-4452-b8f8-f8bd6aa35329 tempest-VolumesCloneTest-1055162215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1ceca9ff-2077-4452-b8f8-f8bd6aa35329 tempest-VolumesCloneTest-1055162215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1ceca9ff-2077-4452-b8f8-f8bd6aa35329 tempest-VolumesCloneTest-1055162215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:31 devstack sudo[88029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:46:31 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-5f62087a-03f1-40fe-97c5-ea1d47cfb5d2 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:31 devstack sudo[88031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-5f62087a-03f1-40fe-97c5-ea1d47cfb5d2 Apr 16 19:46:31 devstack sudo[88031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:31 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:46:31 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Flow 'volume_create_manager' (2611d8e8-21b8-4ef0-825b-19d296226fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:31 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e56b2cc6-6974-4be8-aa47-df1eb581b2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:31 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e56b2cc6-6974-4be8-aa47-df1eb581b2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-696205826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd31de0-0e2d-4872-86f1-f24adca1eaca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea8b89d83c44144ac02e09f9342e735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:32Z,use_quota=True,user_id='0f5427e560c14c92b5bd927c2dc6b27d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:31 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb5294a6-d8e8-4218-8d42-729af81ed89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:31 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb5294a6-d8e8-4218-8d42-729af81ed89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:31 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b7aa90-c174-4578-b29c-5579432daa94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:31 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b7aa90-c174-4578-b29c-5579432daa94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bd31de0-0e2d-4872-86f1-f24adca1eaca', 'volume_name': 'volume-8bd31de0-0e2d-4872-86f1-f24adca1eaca', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:31 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6787c3d4-7e63-48f2-923e-b4692bd14cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6787c3d4-7e63-48f2-923e-b4692bd14cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:32 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5dd088-8d12-4e73-ab09-674412f55796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:32 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Volume 8bd31de0-0e2d-4872-86f1-f24adca1eaca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bd31de0-0e2d-4872-86f1-f24adca1eaca', 'volume_size': 1} Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1ceca9ff-2077-4452-b8f8-f8bd6aa35329 tempest-VolumesCloneTest-1055162215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.521s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-1ceca9ff-2077-4452-b8f8-f8bd6aa35329 tempest-VolumesCloneTest-1055162215 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:46:32 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-1ceca9ff-2077-4452-b8f8-f8bd6aa35329 tempest-VolumesCloneTest-1055162215 None] Deleted volume successfully. Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1ceca9ff-2077-4452-b8f8-f8bd6aa35329 tempest-VolumesCloneTest-1055162215 None] Lock "cinder-d3d6a0c4-470e-4d22-9a36-559b2bb2805c-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:32 devstack sudo[88031]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-5f62087a-03f1-40fe-97c5-ea1d47cfb5d2" returned: 0 in 0.548s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.995s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1913881593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f74da6f8-2c60-448d-b351-500fccd4c12a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4dfec79959405fb52b5351e94bb00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:23Z,use_quota=True,user_id='5bd713ed454b4ad7b5ff403a339484e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Creating volume f74da6f8-2c60-448d-b351-500fccd4c12a {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:46:32 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f74da6f8-2c60-448d-b351-500fccd4c12a 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369bb0c1-7ed8-47fb-abe8-0570b8a4abc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f62087a-03f1-40fe-97c5-ea1d47cfb5d2', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:32 devstack sudo[88035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f74da6f8-2c60-448d-b351-500fccd4c12a 1073741824 Apr 16 19:46:32 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a75e09ef-8361-4d64-9f46-c30822a97698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:32 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Volume volume-5f62087a-03f1-40fe-97c5-ea1d47cfb5d2 (5f62087a-03f1-40fe-97c5-ea1d47cfb5d2): created successfully Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a75e09ef-8361-4d64-9f46-c30822a97698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Flow 'volume_create_manager' (f74071b8-0124-40c3-bbc4-7335e7eb99bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:32 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-78005ed1-77e4-47f2-9912-7741a4f04b3a tempest-CreateVolumesFromImageTest-954586148 None] Created volume successfully. Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-dd1a97bd-bd0e-4108-92c5-d2ac6b1b0c79 tempest-VolumesCloneTest-1055162215 None] Acquiring lock "cinder-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-dd1a97bd-bd0e-4108-92c5-d2ac6b1b0c79 tempest-VolumesCloneTest-1055162215 None] Lock "cinder-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-dd1a97bd-bd0e-4108-92c5-d2ac6b1b0c79 tempest-VolumesCloneTest-1055162215 None] Acquiring lock "cinder-quobyte-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-dd1a97bd-bd0e-4108-92c5-d2ac6b1b0c79 tempest-VolumesCloneTest-1055162215 None] Lock "cinder-quobyte-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e418227-3f3d-4a1e-b274-fc70848fabcf]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-dd1a97bd-bd0e-4108-92c5-d2ac6b1b0c79 tempest-VolumesCloneTest-1055162215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:32 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f74da6f8-2c60-448d-b351-500fccd4c12a 1073741824" returned: 0 in 0.634s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:32 devstack sudo[88040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d Apr 16 19:46:32 devstack sudo[88040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f74da6f8-2c60-448d-b351-500fccd4c12a {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:32 devstack sudo[88042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f74da6f8-2c60-448d-b351-500fccd4c12a Apr 16 19:46:32 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:33 devstack sudo[88040]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-dd1a97bd-bd0e-4108-92c5-d2ac6b1b0c79 tempest-VolumesCloneTest-1055162215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d" returned: 0 in 0.542s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-dd1a97bd-bd0e-4108-92c5-d2ac6b1b0c79 tempest-VolumesCloneTest-1055162215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:33 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f74da6f8-2c60-448d-b351-500fccd4c12a" returned: 0 in 0.466s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:33 devstack sudo[88048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d Apr 16 19:46:33 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.922s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1621887829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5902243-65a8-4545-85e5-1c13d4e392eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4dfec79959405fb52b5351e94bb00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:23Z,use_quota=True,user_id='5bd713ed454b4ad7b5ff403a339484e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Creating volume f5902243-65a8-4545-85e5-1c13d4e392eb {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:46:33 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f5902243-65a8-4545-85e5-1c13d4e392eb 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a81768-5c31-4015-87c1-19cb887f97fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f74da6f8-2c60-448d-b351-500fccd4c12a', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e82d802-6f03-494d-91bd-c635e27afde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:33 devstack sudo[88050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f5902243-65a8-4545-85e5-1c13d4e392eb 1073741824 Apr 16 19:46:33 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:33 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Volume volume-f74da6f8-2c60-448d-b351-500fccd4c12a (f74da6f8-2c60-448d-b351-500fccd4c12a): created successfully Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e82d802-6f03-494d-91bd-c635e27afde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Flow 'volume_create_manager' (2338bc38-f089-4d21-abe6-4d8548eba5cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:33 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-7b8a9528-eb4d-47a0-a94f-af416003abdf tempest-CreateVolumesFromImageTest-954586148 None] Created volume successfully. Apr 16 19:46:33 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-dd1a97bd-bd0e-4108-92c5-d2ac6b1b0c79 tempest-VolumesCloneTest-1055162215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d" returned: 0 in 0.500s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-dd1a97bd-bd0e-4108-92c5-d2ac6b1b0c79 tempest-VolumesCloneTest-1055162215 None] Lock "cinder-quobyte-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d" released by "delete_volume" :: held 1.078s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-dd1a97bd-bd0e-4108-92c5-d2ac6b1b0c79 tempest-VolumesCloneTest-1055162215 None] Created reservations ['dd2d0bb1-6883-4099-b60d-65948110d5bb', 'f6e5a937-1d39-487c-bbeb-e7ec71bcbcdc', 'd2ea022b-87f6-4748-b856-3d497ed55a97', '4059cf88-2661-4eb2-9ecb-db5b4201e3c4'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-dd1a97bd-bd0e-4108-92c5-d2ac6b1b0c79 tempest-VolumesCloneTest-1055162215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-dd1a97bd-bd0e-4108-92c5-d2ac6b1b0c79 tempest-VolumesCloneTest-1055162215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-dd1a97bd-bd0e-4108-92c5-d2ac6b1b0c79 tempest-VolumesCloneTest-1055162215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-dd1a97bd-bd0e-4108-92c5-d2ac6b1b0c79 tempest-VolumesCloneTest-1055162215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-dd1a97bd-bd0e-4108-92c5-d2ac6b1b0c79 tempest-VolumesCloneTest-1055162215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-dd1a97bd-bd0e-4108-92c5-d2ac6b1b0c79 tempest-VolumesCloneTest-1055162215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:33 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:33 devstack sudo[88057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:46:33 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f5902243-65a8-4545-85e5-1c13d4e392eb 1073741824" returned: 0 in 0.596s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f5902243-65a8-4545-85e5-1c13d4e392eb {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:33 devstack sudo[88059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f5902243-65a8-4545-85e5-1c13d4e392eb Apr 16 19:46:33 devstack sudo[88059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:34 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-dd1a97bd-bd0e-4108-92c5-d2ac6b1b0c79 tempest-VolumesCloneTest-1055162215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.498s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:34 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-dd1a97bd-bd0e-4108-92c5-d2ac6b1b0c79 tempest-VolumesCloneTest-1055162215 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:46:34 devstack sudo[88059]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f5902243-65a8-4545-85e5-1c13d4e392eb" returned: 0 in 0.459s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:46:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:34 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-dd1a97bd-bd0e-4108-92c5-d2ac6b1b0c79 tempest-VolumesCloneTest-1055162215 None] Deleted volume successfully. Apr 16 19:46:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.815s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-313249110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c9738b8-a038-47bc-938d-e07737c03cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4dfec79959405fb52b5351e94bb00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:23Z,use_quota=True,user_id='5bd713ed454b4ad7b5ff403a339484e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:46:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Creating volume 3c9738b8-a038-47bc-938d-e07737c03cdf {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:46:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:46:34 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:46:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3c9738b8-a038-47bc-938d-e07737c03cdf 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38fc9883-5db1-4687-858d-835622f6d9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5902243-65a8-4545-85e5-1c13d4e392eb', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f277a79-efd3-4335-9fe9-4564b11745a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:34 devstack sudo[88063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3c9738b8-a038-47bc-938d-e07737c03cdf 1073741824 Apr 16 19:46:34 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:34 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Volume volume-f5902243-65a8-4545-85e5-1c13d4e392eb (f5902243-65a8-4545-85e5-1c13d4e392eb): created successfully Apr 16 19:46:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f277a79-efd3-4335-9fe9-4564b11745a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Flow 'volume_create_manager' (8a153fe4-d20e-489b-a313-aec12aac2cb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:34 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-dd1a97bd-bd0e-4108-92c5-d2ac6b1b0c79 tempest-VolumesCloneTest-1055162215 None] Lock "cinder-fcf366bb-f2cf-4bc9-bbf8-8467eaabed6d-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:34 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-5bfaf027-6453-460a-9467-4ea5cd18c46e tempest-CreateVolumesFromImageTest-954586148 None] Created volume successfully. Apr 16 19:46:34 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3c9738b8-a038-47bc-938d-e07737c03cdf 1073741824" returned: 0 in 0.602s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3c9738b8-a038-47bc-938d-e07737c03cdf {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:34 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3c9738b8-a038-47bc-938d-e07737c03cdf Apr 16 19:46:34 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:35 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3c9738b8-a038-47bc-938d-e07737c03cdf" returned: 0 in 0.487s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:35 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:46:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.691s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:35 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-905883300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f383d3f3-e3c6-4eea-98df-72ef784a6404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4dfec79959405fb52b5351e94bb00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:24Z,use_quota=True,user_id='5bd713ed454b4ad7b5ff403a339484e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:46:35 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Creating volume f383d3f3-e3c6-4eea-98df-72ef784a6404 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:46:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:35 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:35 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:35 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:46:35 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:46:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f383d3f3-e3c6-4eea-98df-72ef784a6404 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68cd2609-4c53-4c1e-aa6a-b9a0b94efc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c9738b8-a038-47bc-938d-e07737c03cdf', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a431f823-c951-4c51-9fbd-38eea89bad03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:35 devstack sudo[88071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f383d3f3-e3c6-4eea-98df-72ef784a6404 1073741824 Apr 16 19:46:35 devstack sudo[88071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:35 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Volume volume-3c9738b8-a038-47bc-938d-e07737c03cdf (3c9738b8-a038-47bc-938d-e07737c03cdf): created successfully Apr 16 19:46:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a431f823-c951-4c51-9fbd-38eea89bad03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Flow 'volume_create_manager' (562a9b60-3bcb-40a0-b19a-56e79fdafad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:35 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-6366ea3c-8b0b-443d-a449-07750d244d34 tempest-CreateVolumesFromImageTest-954586148 None] Created volume successfully. Apr 16 19:46:36 devstack sudo[88071]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f383d3f3-e3c6-4eea-98df-72ef784a6404 1073741824" returned: 0 in 0.566s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f383d3f3-e3c6-4eea-98df-72ef784a6404 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:36 devstack sudo[88076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f383d3f3-e3c6-4eea-98df-72ef784a6404 Apr 16 19:46:36 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:36 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f383d3f3-e3c6-4eea-98df-72ef784a6404" returned: 0 in 0.505s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:36 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:46:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.533s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:36 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-696205826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd31de0-0e2d-4872-86f1-f24adca1eaca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea8b89d83c44144ac02e09f9342e735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:32Z,use_quota=True,user_id='0f5427e560c14c92b5bd927c2dc6b27d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:46:36 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Creating volume 8bd31de0-0e2d-4872-86f1-f24adca1eaca {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:46:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:36 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:36 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:36 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:46:36 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:46:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8bd31de0-0e2d-4872-86f1-f24adca1eaca 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:36 devstack sudo[88079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8bd31de0-0e2d-4872-86f1-f24adca1eaca 1073741824 Apr 16 19:46:36 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ef0936-0e6a-4e92-b401-5723423abb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f383d3f3-e3c6-4eea-98df-72ef784a6404', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e15a460c-5271-460c-ad12-9fa0c024495e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:36 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Volume volume-f383d3f3-e3c6-4eea-98df-72ef784a6404 (f383d3f3-e3c6-4eea-98df-72ef784a6404): created successfully Apr 16 19:46:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e15a460c-5271-460c-ad12-9fa0c024495e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Flow 'volume_create_manager' (0009bf2e-0201-459c-a104-009633325ec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:36 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-42c8f7a7-0147-4d3e-af52-c2abea6f13e6 tempest-CreateVolumesFromImageTest-954586148 None] Created volume successfully. Apr 16 19:46:36 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a8c5af6e-607c-4258-b755-d4567da2651f tempest-CreateVolumesFromImageTest-954586148 None] Acquiring lock "cinder-f383d3f3-e3c6-4eea-98df-72ef784a6404-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:36 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a8c5af6e-607c-4258-b755-d4567da2651f tempest-CreateVolumesFromImageTest-954586148 None] Lock "cinder-f383d3f3-e3c6-4eea-98df-72ef784a6404-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:36 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a8c5af6e-607c-4258-b755-d4567da2651f tempest-CreateVolumesFromImageTest-954586148 None] Acquiring lock "cinder-quobyte-f383d3f3-e3c6-4eea-98df-72ef784a6404" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:36 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a8c5af6e-607c-4258-b755-d4567da2651f tempest-CreateVolumesFromImageTest-954586148 None] Lock "cinder-quobyte-f383d3f3-e3c6-4eea-98df-72ef784a6404" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:36 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc5bdb6-8ecf-485d-bede-6ebfd0295351]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a8c5af6e-607c-4258-b755-d4567da2651f tempest-CreateVolumesFromImageTest-954586148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f383d3f3-e3c6-4eea-98df-72ef784a6404 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:36 devstack sudo[88081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f383d3f3-e3c6-4eea-98df-72ef784a6404 Apr 16 19:46:36 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:36 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Flow 'volume_create_manager' (e3de90a5-c2ae-47f1-98d7-4af34ba267d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c661a4ec-6519-47e2-b30d-e839031c09d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c661a4ec-6519-47e2-b30d-e839031c09d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1829492521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99fab615-375e-4550-ba08-40253bd5e2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f410fe4f665849a9aba96f6d1b1bd4dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:37Z,use_quota=True,user_id='740c980cf79d40b2ac620c3a801c13d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (914fbcc6-6c99-4350-b946-81006c08f534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (914fbcc6-6c99-4350-b946-81006c08f534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e72e000d-bf84-430c-a8f0-f6d35ea10785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG cinder.image.glance [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Creating Keystone auth plugin from conf {{(pid=82569) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 19:46:37 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8bd31de0-0e2d-4872-86f1-f24adca1eaca 1073741824" returned: 0 in 0.587s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8bd31de0-0e2d-4872-86f1-f24adca1eaca {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:37 devstack sudo[88086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8bd31de0-0e2d-4872-86f1-f24adca1eaca Apr 16 19:46:37 devstack sudo[88086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e72e000d-bf84-430c-a8f0-f6d35ea10785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '99fab615-375e-4550-ba08-40253bd5e2c0', 'volume_name': 'volume-99fab615-375e-4550-ba08-40253bd5e2c0', 'volume_size': 1, 'image_id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b20df0c408546a0a2fd4c69a0f4b468', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'created_at': datetime.datetime(2026, 4, 16, 17, 35, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 17, 35, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b24e714b-ab34-4c9c-aafe-cd85fa5071e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b24e714b-ab34-4c9c-aafe-cd85fa5071e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d44a8423-adc9-44bb-bcbf-95f120e9b72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:37 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Volume 99fab615-375e-4550-ba08-40253bd5e2c0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-99fab615-375e-4550-ba08-40253bd5e2c0', 'volume_size': 1, 'image_id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b20df0c408546a0a2fd4c69a0f4b468', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'created_at': datetime.datetime(2026, 4, 16, 17, 35, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 17, 35, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Trying to clone 99fab615-375e-4550-ba08-40253bd5e2c0 from image ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'metadata': {}}]). {{(pid=82569) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6__y8v5qy5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82569) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 19:46:37 devstack cinder-volume[82569]: INFO cinder.image.image_utils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Image download 20.69 MB at 20.69 MB/s Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cb7d4e-e613-47d7-a0ad-faa8d4e84a5f]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6__y8v5qy5devstack@QuobyteHD {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:37 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a8c5af6e-607c-4258-b755-d4567da2651f tempest-CreateVolumesFromImageTest-954586148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f383d3f3-e3c6-4eea-98df-72ef784a6404" returned: 0 in 0.642s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a8c5af6e-607c-4258-b755-d4567da2651f tempest-CreateVolumesFromImageTest-954586148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f383d3f3-e3c6-4eea-98df-72ef784a6404 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:37 devstack sudo[88093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f383d3f3-e3c6-4eea-98df-72ef784a6404 Apr 16 19:46:37 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:37 devstack sudo[88092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6__y8v5qy5devstack@QuobyteHD Apr 16 19:46:37 devstack sudo[88092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:37 devstack sudo[88086]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8bd31de0-0e2d-4872-86f1-f24adca1eaca" returned: 0 in 0.507s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5dd088-8d12-4e73-ab09-674412f55796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bd31de0-0e2d-4872-86f1-f24adca1eaca', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e271d9-e7b7-43e1-a7d7-bdcaaa3347b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:37 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Volume volume-8bd31de0-0e2d-4872-86f1-f24adca1eaca (8bd31de0-0e2d-4872-86f1-f24adca1eaca): created successfully Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e271d9-e7b7-43e1-a7d7-bdcaaa3347b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Flow 'volume_create_manager' (2611d8e8-21b8-4ef0-825b-19d296226fd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:37 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-e245609f-13c1-4c00-90bd-ad1ab7abb112 tempest-VolumesListAdminTestJSON-1529682493 None] Created volume successfully. Apr 16 19:46:37 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a8c5af6e-607c-4258-b755-d4567da2651f tempest-CreateVolumesFromImageTest-954586148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f383d3f3-e3c6-4eea-98df-72ef784a6404" returned: 0 in 0.464s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a8c5af6e-607c-4258-b755-d4567da2651f tempest-CreateVolumesFromImageTest-954586148 None] Lock "cinder-quobyte-f383d3f3-e3c6-4eea-98df-72ef784a6404" released by "delete_volume" :: held 1.138s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:37 devstack sudo[88092]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6__y8v5qy5devstack@QuobyteHD" returned: 0 in 0.537s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:37 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Temporary image ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 is fetched for user 740c980cf79d40b2ac620c3a801c13d3. {{(pid=82569) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-a8c5af6e-607c-4258-b755-d4567da2651f tempest-CreateVolumesFromImageTest-954586148 None] Created reservations ['d72dcf52-9ce4-4961-a287-0fbbe4bae5b1', 'ec452ae6-d6d2-4511-8453-d4e4768994d3', '687eabca-d718-4ebb-84b5-a550bfce9d16', 'b0f629b7-4e2d-49c6-909d-65887d58454d'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[a827fcda-fc57-467b-b57e-495fb249da51]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6__y8v5qy5devstack@QuobyteHD {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a8c5af6e-607c-4258-b755-d4567da2651f tempest-CreateVolumesFromImageTest-954586148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a8c5af6e-607c-4258-b755-d4567da2651f tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-a8c5af6e-607c-4258-b755-d4567da2651f tempest-CreateVolumesFromImageTest-954586148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-a8c5af6e-607c-4258-b755-d4567da2651f tempest-CreateVolumesFromImageTest-954586148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a8c5af6e-607c-4258-b755-d4567da2651f tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a8c5af6e-607c-4258-b755-d4567da2651f tempest-CreateVolumesFromImageTest-954586148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:38 devstack sudo[88102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:46:38 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:38 devstack sudo[88101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6__y8v5qy5devstack@QuobyteHD Apr 16 19:46:38 devstack sudo[88101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:38 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a8c5af6e-607c-4258-b755-d4567da2651f tempest-CreateVolumesFromImageTest-954586148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.451s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-a8c5af6e-607c-4258-b755-d4567da2651f tempest-CreateVolumesFromImageTest-954586148 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:46:38 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-a8c5af6e-607c-4258-b755-d4567da2651f tempest-CreateVolumesFromImageTest-954586148 None] Deleted volume successfully. Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a8c5af6e-607c-4258-b755-d4567da2651f tempest-CreateVolumesFromImageTest-954586148 None] Lock "cinder-f383d3f3-e3c6-4eea-98df-72ef784a6404-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:38 devstack sudo[88101]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6__y8v5qy5devstack@QuobyteHD" returned: 0 in 0.530s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1829492521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99fab615-375e-4550-ba08-40253bd5e2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f410fe4f665849a9aba96f6d1b1bd4dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:37Z,use_quota=True,user_id='740c980cf79d40b2ac620c3a801c13d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Creating volume 99fab615-375e-4550-ba08-40253bd5e2c0 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:46:38 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:38 devstack sudo[88109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0 1073741824 Apr 16 19:46:38 devstack sudo[88109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Flow 'volume_create_manager' (8390048a-68c4-4ce9-a47c-c1f8508a2d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b7d84e-caab-4ace-b157-36fa2803acd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b7d84e-caab-4ace-b157-36fa2803acd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2063823786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ddf2d6-0d4b-4e49-9076-ea752aa79e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea8b89d83c44144ac02e09f9342e735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:39Z,use_quota=True,user_id='0f5427e560c14c92b5bd927c2dc6b27d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b63a0b-5adc-42fa-a631-5f7b9cfe69cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b63a0b-5adc-42fa-a631-5f7b9cfe69cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1731dba-e0e9-4d67-8476-a081d478bf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1731dba-e0e9-4d67-8476-a081d478bf85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5ddf2d6-0d4b-4e49-9076-ea752aa79e51', 'volume_name': 'volume-d5ddf2d6-0d4b-4e49-9076-ea752aa79e51', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a6931f-5da9-442c-9419-f529b837846c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a6931f-5da9-442c-9419-f529b837846c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e2bb131-8c36-42ef-8781-c84a6c54ec9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:38 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Volume d5ddf2d6-0d4b-4e49-9076-ea752aa79e51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5ddf2d6-0d4b-4e49-9076-ea752aa79e51', 'volume_size': 1} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5bf00767-e610-484d-8a2e-a16e84d7fd99 tempest-CreateVolumesFromImageTest-954586148 None] Acquiring lock "cinder-3c9738b8-a038-47bc-938d-e07737c03cdf-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5bf00767-e610-484d-8a2e-a16e84d7fd99 tempest-CreateVolumesFromImageTest-954586148 None] Lock "cinder-3c9738b8-a038-47bc-938d-e07737c03cdf-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5bf00767-e610-484d-8a2e-a16e84d7fd99 tempest-CreateVolumesFromImageTest-954586148 None] Acquiring lock "cinder-quobyte-3c9738b8-a038-47bc-938d-e07737c03cdf" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:38 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5bf00767-e610-484d-8a2e-a16e84d7fd99 tempest-CreateVolumesFromImageTest-954586148 None] Lock "cinder-quobyte-3c9738b8-a038-47bc-938d-e07737c03cdf" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:39 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[62353d23-a2a5-4ad2-957d-bd2882131086]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5bf00767-e610-484d-8a2e-a16e84d7fd99 tempest-CreateVolumesFromImageTest-954586148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3c9738b8-a038-47bc-938d-e07737c03cdf {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:39 devstack sudo[88111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3c9738b8-a038-47bc-938d-e07737c03cdf Apr 16 19:46:39 devstack sudo[88111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:39 devstack sudo[88109]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0 1073741824" returned: 0 in 0.599s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:39 devstack sudo[88116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0 Apr 16 19:46:39 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:39 devstack sudo[88111]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5bf00767-e610-484d-8a2e-a16e84d7fd99 tempest-CreateVolumesFromImageTest-954586148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3c9738b8-a038-47bc-938d-e07737c03cdf" returned: 0 in 0.545s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5bf00767-e610-484d-8a2e-a16e84d7fd99 tempest-CreateVolumesFromImageTest-954586148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3c9738b8-a038-47bc-938d-e07737c03cdf {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:39 devstack sudo[88121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3c9738b8-a038-47bc-938d-e07737c03cdf Apr 16 19:46:39 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:39 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0" returned: 0 in 0.456s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:46:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.951s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2063823786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ddf2d6-0d4b-4e49-9076-ea752aa79e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea8b89d83c44144ac02e09f9342e735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:39Z,use_quota=True,user_id='0f5427e560c14c92b5bd927c2dc6b27d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:46:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Creating volume d5ddf2d6-0d4b-4e49-9076-ea752aa79e51 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:46:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:46:39 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:46:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d5ddf2d6-0d4b-4e49-9076-ea752aa79e51 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:39 devstack sudo[88124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d5ddf2d6-0d4b-4e49-9076-ea752aa79e51 1073741824 Apr 16 19:46:39 devstack sudo[88124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:39 devstack cinder-volume[82569]: DEBUG cinder.volume.volume_utils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Attempting download of ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'metadata': {}}])) to volume 99fab615-375e-4550-ba08-40253bd5e2c0. {{(pid=82569) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 16 19:46:39 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[99578f68-2735-4552-9d45-2b8865dd4458]: (4, 'raw') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_7wempgku {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:39 devstack sudo[88126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_7wempgku Apr 16 19:46:39 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:40 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5bf00767-e610-484d-8a2e-a16e84d7fd99 tempest-CreateVolumesFromImageTest-954586148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3c9738b8-a038-47bc-938d-e07737c03cdf" returned: 0 in 0.494s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:40 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5bf00767-e610-484d-8a2e-a16e84d7fd99 tempest-CreateVolumesFromImageTest-954586148 None] Lock "cinder-quobyte-3c9738b8-a038-47bc-938d-e07737c03cdf" released by "delete_volume" :: held 1.068s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:40 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-5bf00767-e610-484d-8a2e-a16e84d7fd99 tempest-CreateVolumesFromImageTest-954586148 None] Created reservations ['82ed04c3-f676-4292-a951-fd0e42f5b981', 'ae6a2361-7b44-4f62-81e3-b3d6e3f5eea3', '5fda8e97-e402-4f89-90e9-411004a98f32', 'aef52213-69fe-4524-bde4-d6f4f4db24dc'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:46:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5bf00767-e610-484d-8a2e-a16e84d7fd99 tempest-CreateVolumesFromImageTest-954586148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5bf00767-e610-484d-8a2e-a16e84d7fd99 tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5bf00767-e610-484d-8a2e-a16e84d7fd99 tempest-CreateVolumesFromImageTest-954586148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5bf00767-e610-484d-8a2e-a16e84d7fd99 tempest-CreateVolumesFromImageTest-954586148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5bf00767-e610-484d-8a2e-a16e84d7fd99 tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5bf00767-e610-484d-8a2e-a16e84d7fd99 tempest-CreateVolumesFromImageTest-954586148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:40 devstack sudo[88132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:46:40 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:40 devstack sudo[88124]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d5ddf2d6-0d4b-4e49-9076-ea752aa79e51 1073741824" returned: 0 in 0.568s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d5ddf2d6-0d4b-4e49-9076-ea752aa79e51 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:40 devstack sudo[88136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d5ddf2d6-0d4b-4e49-9076-ea752aa79e51 Apr 16 19:46:40 devstack sudo[88136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:40 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_7wempgku" returned: 0 in 0.582s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_7wempgku {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:40 devstack sudo[88138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_7wempgku Apr 16 19:46:40 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:40 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5bf00767-e610-484d-8a2e-a16e84d7fd99 tempest-CreateVolumesFromImageTest-954586148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.466s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:40 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-5bf00767-e610-484d-8a2e-a16e84d7fd99 tempest-CreateVolumesFromImageTest-954586148 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:46:40 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-5bf00767-e610-484d-8a2e-a16e84d7fd99 tempest-CreateVolumesFromImageTest-954586148 None] Deleted volume successfully. Apr 16 19:46:40 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5bf00767-e610-484d-8a2e-a16e84d7fd99 tempest-CreateVolumesFromImageTest-954586148 None] Lock "cinder-3c9738b8-a038-47bc-938d-e07737c03cdf-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:40 devstack sudo[88136]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d5ddf2d6-0d4b-4e49-9076-ea752aa79e51" returned: 0 in 0.471s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:46:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e2bb131-8c36-42ef-8781-c84a6c54ec9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5ddf2d6-0d4b-4e49-9076-ea752aa79e51', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd12c232-8da2-4c8e-8394-4b471102a884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:40 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Volume volume-d5ddf2d6-0d4b-4e49-9076-ea752aa79e51 (d5ddf2d6-0d4b-4e49-9076-ea752aa79e51): created successfully Apr 16 19:46:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd12c232-8da2-4c8e-8394-4b471102a884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Flow 'volume_create_manager' (8390048a-68c4-4ce9-a47c-c1f8508a2d28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:40 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-aa8f9874-6261-4ce3-b30e-abd5ce56eefa tempest-VolumesListAdminTestJSON-1529682493 None] Created volume successfully. Apr 16 19:46:40 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_7wempgku" returned: 1 in 0.519s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_7wempgku' failed. Not Retrying. {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 19:46:40 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b7765d-14cf-4184-838b-cc0abb4b68f9]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6__y8v5qy5devstack@QuobyteHD {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:40 devstack sudo[88144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6__y8v5qy5devstack@QuobyteHD Apr 16 19:46:40 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:41 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-20ac978c-bf02-44fb-828b-9684f5ff4a73 tempest-CreateVolumesFromImageTest-954586148 None] Acquiring lock "cinder-f5902243-65a8-4545-85e5-1c13d4e392eb-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:41 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-20ac978c-bf02-44fb-828b-9684f5ff4a73 tempest-CreateVolumesFromImageTest-954586148 None] Lock "cinder-f5902243-65a8-4545-85e5-1c13d4e392eb-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:41 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-20ac978c-bf02-44fb-828b-9684f5ff4a73 tempest-CreateVolumesFromImageTest-954586148 None] Acquiring lock "cinder-quobyte-f5902243-65a8-4545-85e5-1c13d4e392eb" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:41 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-20ac978c-bf02-44fb-828b-9684f5ff4a73 tempest-CreateVolumesFromImageTest-954586148 None] Lock "cinder-quobyte-f5902243-65a8-4545-85e5-1c13d4e392eb" acquired by "delete_volume" :: waited 0.007s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:41 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[af03b130-3b59-4bfb-bc43-7ae017b74ed7]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-20ac978c-bf02-44fb-828b-9684f5ff4a73 tempest-CreateVolumesFromImageTest-954586148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f5902243-65a8-4545-85e5-1c13d4e392eb {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:41 devstack sudo[88146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f5902243-65a8-4545-85e5-1c13d4e392eb Apr 16 19:46:41 devstack sudo[88146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:41 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6__y8v5qy5devstack@QuobyteHD" returned: 0 in 0.471s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:41 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 was qcow2, converting to raw {{(pid=82569) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 19:46:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6__y8v5qy5devstack@QuobyteHD /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:41 devstack sudo[88151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6__y8v5qy5devstack@QuobyteHD /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0 Apr 16 19:46:41 devstack sudo[88151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:41 devstack sudo[88146]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-20ac978c-bf02-44fb-828b-9684f5ff4a73 tempest-CreateVolumesFromImageTest-954586148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f5902243-65a8-4545-85e5-1c13d4e392eb" returned: 0 in 0.486s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-20ac978c-bf02-44fb-828b-9684f5ff4a73 tempest-CreateVolumesFromImageTest-954586148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f5902243-65a8-4545-85e5-1c13d4e392eb {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:41 devstack sudo[88159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f5902243-65a8-4545-85e5-1c13d4e392eb Apr 16 19:46:41 devstack sudo[88159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:42 devstack sudo[88159]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-20ac978c-bf02-44fb-828b-9684f5ff4a73 tempest-CreateVolumesFromImageTest-954586148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f5902243-65a8-4545-85e5-1c13d4e392eb" returned: 0 in 0.606s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-20ac978c-bf02-44fb-828b-9684f5ff4a73 tempest-CreateVolumesFromImageTest-954586148 None] Lock "cinder-quobyte-f5902243-65a8-4545-85e5-1c13d4e392eb" released by "delete_volume" :: held 1.121s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-20ac978c-bf02-44fb-828b-9684f5ff4a73 tempest-CreateVolumesFromImageTest-954586148 None] Created reservations ['e2061ed5-484f-4baa-b3ec-591c5da85f1e', '06920e2f-b3ba-4723-bceb-f5f75065713d', 'cdf20984-af72-4093-a337-f38694791ed8', '91195c44-04f3-48e3-a854-c592354ace53'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:46:42 devstack sudo[88151]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Flow 'volume_create_manager' (a1eb8724-6ba0-474a-b3ef-b3a4fc4e4281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea932a22-d694-48f4-b8ff-1d8adb2e0133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6__y8v5qy5devstack@QuobyteHD /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0" returned: 0 in 1.105s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6__y8v5qy5devstack@QuobyteHD, size 112.00 MB, duration 1.11 sec, destination /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0 {{(pid=82569) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 19:46:42 devstack cinder-volume[82569]: INFO cinder.image.image_utils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Converted 112.00 MB image at 101.29 MB/s Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea932a22-d694-48f4-b8ff-1d8adb2e0133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5975d932-0484-46d3-8c3b-7fdece9eb46e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f31cc9e267b4880a77dcc5ef3b6bd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:42Z,use_quota=True,user_id='7f7bdcb592224368ad33f8e289b87fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:42 devstack sudo[88165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0 1G Apr 16 19:46:42 devstack sudo[88165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (958f2f2e-e0c3-4546-aa2b-20b45f17f8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (958f2f2e-e0c3-4546-aa2b-20b45f17f8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbca6b22-a544-423e-8916-483d1d4d6d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbca6b22-a544-423e-8916-483d1d4d6d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5975d932-0484-46d3-8c3b-7fdece9eb46e', 'volume_name': 'volume-5975d932-0484-46d3-8c3b-7fdece9eb46e', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d26d60-1a97-40d7-8ece-51e7fa3a125d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d26d60-1a97-40d7-8ece-51e7fa3a125d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3875fe5a-202f-47dc-8715-5bc8155ae04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:42 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Volume 5975d932-0484-46d3-8c3b-7fdece9eb46e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5975d932-0484-46d3-8c3b-7fdece9eb46e', 'volume_size': 1} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5975d932-0484-46d3-8c3b-7fdece9eb46e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f31cc9e267b4880a77dcc5ef3b6bd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:42Z,use_quota=True,user_id='7f7bdcb592224368ad33f8e289b87fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Creating volume 5975d932-0484-46d3-8c3b-7fdece9eb46e {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:46:42 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-5975d932-0484-46d3-8c3b-7fdece9eb46e 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:42 devstack sudo[88167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-5975d932-0484-46d3-8c3b-7fdece9eb46e 1073741824 Apr 16 19:46:42 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-20ac978c-bf02-44fb-828b-9684f5ff4a73 tempest-CreateVolumesFromImageTest-954586148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-20ac978c-bf02-44fb-828b-9684f5ff4a73 tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-20ac978c-bf02-44fb-828b-9684f5ff4a73 tempest-CreateVolumesFromImageTest-954586148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-20ac978c-bf02-44fb-828b-9684f5ff4a73 tempest-CreateVolumesFromImageTest-954586148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-20ac978c-bf02-44fb-828b-9684f5ff4a73 tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-20ac978c-bf02-44fb-828b-9684f5ff4a73 tempest-CreateVolumesFromImageTest-954586148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:42 devstack sudo[88169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:46:42 devstack sudo[88169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:42 devstack sudo[88165]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0 1G" returned: 0 in 0.440s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e44e56-0f70-44e5-878e-3d378aba015a]: (4, 'raw') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:42 devstack sudo[88178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0 Apr 16 19:46:42 devstack sudo[88178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:43 devstack sudo[88169]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-20ac978c-bf02-44fb-828b-9684f5ff4a73 tempest-CreateVolumesFromImageTest-954586148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.462s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:43 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-20ac978c-bf02-44fb-828b-9684f5ff4a73 tempest-CreateVolumesFromImageTest-954586148 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:46:43 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-20ac978c-bf02-44fb-828b-9684f5ff4a73 tempest-CreateVolumesFromImageTest-954586148 None] Deleted volume successfully. Apr 16 19:46:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-20ac978c-bf02-44fb-828b-9684f5ff4a73 tempest-CreateVolumesFromImageTest-954586148 None] Lock "cinder-f5902243-65a8-4545-85e5-1c13d4e392eb-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:43 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-5975d932-0484-46d3-8c3b-7fdece9eb46e 1073741824" returned: 0 in 0.545s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-5975d932-0484-46d3-8c3b-7fdece9eb46e {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:43 devstack sudo[88180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-5975d932-0484-46d3-8c3b-7fdece9eb46e Apr 16 19:46:43 devstack sudo[88180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-912bd03f-32ae-454c-913f-2b9f0b3dbe9b tempest-CreateVolumesFromImageTest-954586148 None] Acquiring lock "cinder-f74da6f8-2c60-448d-b351-500fccd4c12a-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-912bd03f-32ae-454c-913f-2b9f0b3dbe9b tempest-CreateVolumesFromImageTest-954586148 None] Lock "cinder-f74da6f8-2c60-448d-b351-500fccd4c12a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-912bd03f-32ae-454c-913f-2b9f0b3dbe9b tempest-CreateVolumesFromImageTest-954586148 None] Acquiring lock "cinder-quobyte-f74da6f8-2c60-448d-b351-500fccd4c12a" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-912bd03f-32ae-454c-913f-2b9f0b3dbe9b tempest-CreateVolumesFromImageTest-954586148 None] Lock "cinder-quobyte-f74da6f8-2c60-448d-b351-500fccd4c12a" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:43 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[784b7eab-1863-40e6-b053-373f41dd6fa8]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-912bd03f-32ae-454c-913f-2b9f0b3dbe9b tempest-CreateVolumesFromImageTest-954586148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f74da6f8-2c60-448d-b351-500fccd4c12a {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:43 devstack sudo[88178]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0" returned: 0 in 0.603s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:43 devstack sudo[88186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f74da6f8-2c60-448d-b351-500fccd4c12a Apr 16 19:46:43 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:43 devstack sudo[88180]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-5975d932-0484-46d3-8c3b-7fdece9eb46e" returned: 0 in 0.528s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:43 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:46:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:43 devstack sudo[88187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0 Apr 16 19:46:43 devstack sudo[88187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3875fe5a-202f-47dc-8715-5bc8155ae04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5975d932-0484-46d3-8c3b-7fdece9eb46e', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f984ebd-f707-4573-b142-ce0a74f31291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:43 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Volume volume-5975d932-0484-46d3-8c3b-7fdece9eb46e (5975d932-0484-46d3-8c3b-7fdece9eb46e): created successfully Apr 16 19:46:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f984ebd-f707-4573-b142-ce0a74f31291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Flow 'volume_create_manager' (a1eb8724-6ba0-474a-b3ef-b3a4fc4e4281) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:43 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-a09972ae-595d-4d2d-9426-65323931006d tempest-VolumesListAdminTestJSON-13779096 None] Created volume successfully. Apr 16 19:46:44 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-912bd03f-32ae-454c-913f-2b9f0b3dbe9b tempest-CreateVolumesFromImageTest-954586148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f74da6f8-2c60-448d-b351-500fccd4c12a" returned: 0 in 0.565s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-912bd03f-32ae-454c-913f-2b9f0b3dbe9b tempest-CreateVolumesFromImageTest-954586148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f74da6f8-2c60-448d-b351-500fccd4c12a {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:44 devstack sudo[88197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f74da6f8-2c60-448d-b351-500fccd4c12a Apr 16 19:46:44 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:44 devstack sudo[88187]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0" returned: 1 in 0.582s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0' failed. Not Retrying. {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG cinder.volume.volume_utils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Downloaded image ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'metadata': {}}])) to volume 99fab615-375e-4550-ba08-40253bd5e2c0 successfully. {{(pid=82569) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Temporary image ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 for user 740c980cf79d40b2ac620c3a801c13d3 is deleted. {{(pid=82569) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG cinder.volume.volume_utils [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Marking volume 99fab615-375e-4550-ba08-40253bd5e2c0 as bootable. {{(pid=82569) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Copying metadata from image ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 to 99fab615-375e-4550-ba08-40253bd5e2c0. {{(pid=82569) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Creating volume glance metadata for volume 99fab615-375e-4550-ba08-40253bd5e2c0 backed by image ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82569) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d44a8423-adc9-44bb-bcbf-95f120e9b72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99fab615-375e-4550-ba08-40253bd5e2c0', 'volume_size': 1, 'image_id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b20df0c408546a0a2fd4c69a0f4b468', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'created_at': datetime.datetime(2026, 4, 16, 17, 35, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 17, 35, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ed9bee-8de3-43e7-8d5c-03e2c05fddd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:44 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Volume volume-99fab615-375e-4550-ba08-40253bd5e2c0 (99fab615-375e-4550-ba08-40253bd5e2c0): created successfully Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ed9bee-8de3-43e7-8d5c-03e2c05fddd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Flow 'volume_create_manager' (e3de90a5-c2ae-47f1-98d7-4af34ba267d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:44 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-f52cb9ac-478c-479a-831a-076c03b01f88 tempest-VolumesExtendTest-263710970 None] Created volume successfully. Apr 16 19:46:44 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-912bd03f-32ae-454c-913f-2b9f0b3dbe9b tempest-CreateVolumesFromImageTest-954586148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f74da6f8-2c60-448d-b351-500fccd4c12a" returned: 0 in 0.442s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3292861a-f84b-4724-936d-18bfa23e7e6c tempest-VolumesExtendTest-263710970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3292861a-f84b-4724-936d-18bfa23e7e6c tempest-VolumesExtendTest-263710970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-912bd03f-32ae-454c-913f-2b9f0b3dbe9b tempest-CreateVolumesFromImageTest-954586148 None] Lock "cinder-quobyte-f74da6f8-2c60-448d-b351-500fccd4c12a" released by "delete_volume" :: held 1.044s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[5830481a-fdd0-4fb8-8af7-ef1bbd5594c6]: (4, 'raw') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3292861a-f84b-4724-936d-18bfa23e7e6c tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-912bd03f-32ae-454c-913f-2b9f0b3dbe9b tempest-CreateVolumesFromImageTest-954586148 None] Created reservations ['076217e6-6662-4ffd-91f4-2aec5bc5298c', '84253202-cbfe-4103-b2fb-aed9ad88d3fc', 'af5d5f2c-8cb4-4911-9ce6-f32fd5f89066', 'e8b4f224-ed8c-466b-bf0e-b03ebe85aadf'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b8f5ac71-1dc8-491f-bd0b-0f538ce8066c tempest-VolumesListAdminTestJSON-13779096 None] Acquiring lock "cinder-5975d932-0484-46d3-8c3b-7fdece9eb46e-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b8f5ac71-1dc8-491f-bd0b-0f538ce8066c tempest-VolumesListAdminTestJSON-13779096 None] Lock "cinder-5975d932-0484-46d3-8c3b-7fdece9eb46e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:44 devstack sudo[88200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0 Apr 16 19:46:44 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-912bd03f-32ae-454c-913f-2b9f0b3dbe9b tempest-CreateVolumesFromImageTest-954586148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-912bd03f-32ae-454c-913f-2b9f0b3dbe9b tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-912bd03f-32ae-454c-913f-2b9f0b3dbe9b tempest-CreateVolumesFromImageTest-954586148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-912bd03f-32ae-454c-913f-2b9f0b3dbe9b tempest-CreateVolumesFromImageTest-954586148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-912bd03f-32ae-454c-913f-2b9f0b3dbe9b tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-912bd03f-32ae-454c-913f-2b9f0b3dbe9b tempest-CreateVolumesFromImageTest-954586148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b8f5ac71-1dc8-491f-bd0b-0f538ce8066c tempest-VolumesListAdminTestJSON-13779096 None] Acquiring lock "cinder-quobyte-5975d932-0484-46d3-8c3b-7fdece9eb46e" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b8f5ac71-1dc8-491f-bd0b-0f538ce8066c tempest-VolumesListAdminTestJSON-13779096 None] Lock "cinder-quobyte-5975d932-0484-46d3-8c3b-7fdece9eb46e" acquired by "delete_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:44 devstack sudo[88202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:46:44 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd3c8f0-6ed4-40d8-8ca3-37563e502a1c]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b8f5ac71-1dc8-491f-bd0b-0f538ce8066c tempest-VolumesListAdminTestJSON-13779096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-5975d932-0484-46d3-8c3b-7fdece9eb46e {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1ea4a45d-98b3-473f-9493-ae7b00ba56d5 tempest-VolumesListAdminTestJSON-1529682493 None] Acquiring lock "cinder-d5ddf2d6-0d4b-4e49-9076-ea752aa79e51-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1ea4a45d-98b3-473f-9493-ae7b00ba56d5 tempest-VolumesListAdminTestJSON-1529682493 None] Lock "cinder-d5ddf2d6-0d4b-4e49-9076-ea752aa79e51-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:44 devstack sudo[88204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-5975d932-0484-46d3-8c3b-7fdece9eb46e Apr 16 19:46:44 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1ea4a45d-98b3-473f-9493-ae7b00ba56d5 tempest-VolumesListAdminTestJSON-1529682493 None] Acquiring lock "cinder-quobyte-d5ddf2d6-0d4b-4e49-9076-ea752aa79e51" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1ea4a45d-98b3-473f-9493-ae7b00ba56d5 tempest-VolumesListAdminTestJSON-1529682493 None] Lock "cinder-quobyte-d5ddf2d6-0d4b-4e49-9076-ea752aa79e51" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[0223e764-3bcc-4cd4-ac92-b3df484c1c3c]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1ea4a45d-98b3-473f-9493-ae7b00ba56d5 tempest-VolumesListAdminTestJSON-1529682493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d5ddf2d6-0d4b-4e49-9076-ea752aa79e51 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:44 devstack sudo[88206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d5ddf2d6-0d4b-4e49-9076-ea752aa79e51 Apr 16 19:46:44 devstack sudo[88206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:45 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3292861a-f84b-4724-936d-18bfa23e7e6c tempest-VolumesExtendTest-263710970 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0" returned: 0 in 0.574s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3292861a-f84b-4724-936d-18bfa23e7e6c tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:45 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-912bd03f-32ae-454c-913f-2b9f0b3dbe9b tempest-CreateVolumesFromImageTest-954586148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.526s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-912bd03f-32ae-454c-913f-2b9f0b3dbe9b tempest-CreateVolumesFromImageTest-954586148 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:46:45 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-912bd03f-32ae-454c-913f-2b9f0b3dbe9b tempest-CreateVolumesFromImageTest-954586148 None] Deleted volume successfully. Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG dbcounter [-] [82569] Writing DB stats cinder:SELECT=169,cinder:INSERT=53,cinder:UPDATE=221,cinder:DELETE=21 {{(pid=82569) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-912bd03f-32ae-454c-913f-2b9f0b3dbe9b tempest-CreateVolumesFromImageTest-954586148 None] Lock "cinder-f74da6f8-2c60-448d-b351-500fccd4c12a-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:45 devstack sudo[88211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0 Apr 16 19:46:45 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:45 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b8f5ac71-1dc8-491f-bd0b-0f538ce8066c tempest-VolumesListAdminTestJSON-13779096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-5975d932-0484-46d3-8c3b-7fdece9eb46e" returned: 0 in 0.571s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b8f5ac71-1dc8-491f-bd0b-0f538ce8066c tempest-VolumesListAdminTestJSON-13779096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-5975d932-0484-46d3-8c3b-7fdece9eb46e {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:45 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-5975d932-0484-46d3-8c3b-7fdece9eb46e Apr 16 19:46:45 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:45 devstack sudo[88206]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1ea4a45d-98b3-473f-9493-ae7b00ba56d5 tempest-VolumesListAdminTestJSON-1529682493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d5ddf2d6-0d4b-4e49-9076-ea752aa79e51" returned: 0 in 0.522s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1ea4a45d-98b3-473f-9493-ae7b00ba56d5 tempest-VolumesListAdminTestJSON-1529682493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d5ddf2d6-0d4b-4e49-9076-ea752aa79e51 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:45 devstack sudo[88221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d5ddf2d6-0d4b-4e49-9076-ea752aa79e51 Apr 16 19:46:45 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b8bf18e9-486e-4532-846a-748faa0f187b tempest-CreateVolumesFromImageTest-954586148 None] Acquiring lock "cinder-5f62087a-03f1-40fe-97c5-ea1d47cfb5d2-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b8bf18e9-486e-4532-846a-748faa0f187b tempest-CreateVolumesFromImageTest-954586148 None] Lock "cinder-5f62087a-03f1-40fe-97c5-ea1d47cfb5d2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:45 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3292861a-f84b-4724-936d-18bfa23e7e6c tempest-VolumesExtendTest-263710970 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0" returned: 1 in 0.594s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3292861a-f84b-4724-936d-18bfa23e7e6c tempest-VolumesExtendTest-263710970 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0' failed. Not Retrying. {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3292861a-f84b-4724-936d-18bfa23e7e6c tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0 2G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b8bf18e9-486e-4532-846a-748faa0f187b tempest-CreateVolumesFromImageTest-954586148 None] Acquiring lock "cinder-quobyte-5f62087a-03f1-40fe-97c5-ea1d47cfb5d2" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b8bf18e9-486e-4532-846a-748faa0f187b tempest-CreateVolumesFromImageTest-954586148 None] Lock "cinder-quobyte-5f62087a-03f1-40fe-97c5-ea1d47cfb5d2" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1cfebd-1558-43a3-b7f7-8134860b5467]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b8bf18e9-486e-4532-846a-748faa0f187b tempest-CreateVolumesFromImageTest-954586148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-5f62087a-03f1-40fe-97c5-ea1d47cfb5d2 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3292861a-f84b-4724-936d-18bfa23e7e6c tempest-VolumesExtendTest-263710970 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0 2G" returned: 0 in 0.065s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3292861a-f84b-4724-936d-18bfa23e7e6c tempest-VolumesExtendTest-263710970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.275s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:45 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b8f5ac71-1dc8-491f-bd0b-0f538ce8066c tempest-VolumesListAdminTestJSON-13779096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-5975d932-0484-46d3-8c3b-7fdece9eb46e" returned: 0 in 0.530s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b8f5ac71-1dc8-491f-bd0b-0f538ce8066c tempest-VolumesListAdminTestJSON-13779096 None] Lock "cinder-quobyte-5975d932-0484-46d3-8c3b-7fdece9eb46e" released by "delete_volume" :: held 1.130s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:45 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1ea4a45d-98b3-473f-9493-ae7b00ba56d5 tempest-VolumesListAdminTestJSON-1529682493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d5ddf2d6-0d4b-4e49-9076-ea752aa79e51" returned: 0 in 0.493s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:45 devstack sudo[88231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-5f62087a-03f1-40fe-97c5-ea1d47cfb5d2 Apr 16 19:46:45 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:45 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-3292861a-f84b-4724-936d-18bfa23e7e6c tempest-VolumesExtendTest-263710970 None] Extend volume completed successfully. Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1ea4a45d-98b3-473f-9493-ae7b00ba56d5 tempest-VolumesListAdminTestJSON-1529682493 None] Lock "cinder-quobyte-d5ddf2d6-0d4b-4e49-9076-ea752aa79e51" released by "delete_volume" :: held 1.040s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-b8f5ac71-1dc8-491f-bd0b-0f538ce8066c tempest-VolumesListAdminTestJSON-13779096 None] Created reservations ['d948ddcb-c3e2-4ba8-92b9-93609b4abee0', '6074edd0-4a6e-4951-a391-0b5befcac27c', 'a0322db1-2f0d-42a9-9b65-f9f8c122034e', '91c0e5f4-1860-4438-8c02-52dc0f092da6'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b8f5ac71-1dc8-491f-bd0b-0f538ce8066c tempest-VolumesListAdminTestJSON-13779096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b8f5ac71-1dc8-491f-bd0b-0f538ce8066c tempest-VolumesListAdminTestJSON-13779096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-b8f5ac71-1dc8-491f-bd0b-0f538ce8066c tempest-VolumesListAdminTestJSON-13779096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-b8f5ac71-1dc8-491f-bd0b-0f538ce8066c tempest-VolumesListAdminTestJSON-13779096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b8f5ac71-1dc8-491f-bd0b-0f538ce8066c tempest-VolumesListAdminTestJSON-13779096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b8f5ac71-1dc8-491f-bd0b-0f538ce8066c tempest-VolumesListAdminTestJSON-13779096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:45 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-1ea4a45d-98b3-473f-9493-ae7b00ba56d5 tempest-VolumesListAdminTestJSON-1529682493 None] Created reservations ['d913e11e-1514-4a60-9787-d72a1a669669', '517e26f2-8fb8-4791-ae7f-40104581c4c3', 'ae2db2b9-8882-4577-84f0-ce97628c3c9b', '60790cdd-6966-4fa5-8a64-5c70a64bafbf'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:46:45 devstack sudo[88233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:46:45 devstack sudo[88233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1ea4a45d-98b3-473f-9493-ae7b00ba56d5 tempest-VolumesListAdminTestJSON-1529682493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1ea4a45d-98b3-473f-9493-ae7b00ba56d5 tempest-VolumesListAdminTestJSON-1529682493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4a45d-98b3-473f-9493-ae7b00ba56d5 tempest-VolumesListAdminTestJSON-1529682493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4a45d-98b3-473f-9493-ae7b00ba56d5 tempest-VolumesListAdminTestJSON-1529682493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1ea4a45d-98b3-473f-9493-ae7b00ba56d5 tempest-VolumesListAdminTestJSON-1529682493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1ea4a45d-98b3-473f-9493-ae7b00ba56d5 tempest-VolumesListAdminTestJSON-1529682493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:46 devstack sudo[88235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:46:46 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:46 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b8bf18e9-486e-4532-846a-748faa0f187b tempest-CreateVolumesFromImageTest-954586148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-5f62087a-03f1-40fe-97c5-ea1d47cfb5d2" returned: 0 in 0.496s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b8bf18e9-486e-4532-846a-748faa0f187b tempest-CreateVolumesFromImageTest-954586148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-5f62087a-03f1-40fe-97c5-ea1d47cfb5d2 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:46 devstack sudo[88240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-5f62087a-03f1-40fe-97c5-ea1d47cfb5d2 Apr 16 19:46:46 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:46 devstack sudo[88233]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b8f5ac71-1dc8-491f-bd0b-0f538ce8066c tempest-VolumesListAdminTestJSON-13779096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.470s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-b8f5ac71-1dc8-491f-bd0b-0f538ce8066c tempest-VolumesListAdminTestJSON-13779096 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:46:46 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-b8f5ac71-1dc8-491f-bd0b-0f538ce8066c tempest-VolumesListAdminTestJSON-13779096 None] Deleted volume successfully. Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b8f5ac71-1dc8-491f-bd0b-0f538ce8066c tempest-VolumesListAdminTestJSON-13779096 None] Lock "cinder-5975d932-0484-46d3-8c3b-7fdece9eb46e-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:46 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1ea4a45d-98b3-473f-9493-ae7b00ba56d5 tempest-VolumesListAdminTestJSON-1529682493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.458s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-1ea4a45d-98b3-473f-9493-ae7b00ba56d5 tempest-VolumesListAdminTestJSON-1529682493 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:46:46 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-1ea4a45d-98b3-473f-9493-ae7b00ba56d5 tempest-VolumesListAdminTestJSON-1529682493 None] Deleted volume successfully. Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1ea4a45d-98b3-473f-9493-ae7b00ba56d5 tempest-VolumesListAdminTestJSON-1529682493 None] Lock "cinder-d5ddf2d6-0d4b-4e49-9076-ea752aa79e51-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:46 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b8bf18e9-486e-4532-846a-748faa0f187b tempest-CreateVolumesFromImageTest-954586148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-5f62087a-03f1-40fe-97c5-ea1d47cfb5d2" returned: 0 in 0.419s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b8bf18e9-486e-4532-846a-748faa0f187b tempest-CreateVolumesFromImageTest-954586148 None] Lock "cinder-quobyte-5f62087a-03f1-40fe-97c5-ea1d47cfb5d2" released by "delete_volume" :: held 0.938s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-b8bf18e9-486e-4532-846a-748faa0f187b tempest-CreateVolumesFromImageTest-954586148 None] Created reservations ['c2fe1e93-6baa-4eda-a236-3fbd30bce0f5', '6f28f33c-cda0-4eb5-bd40-da9ff813866e', '5fac0b08-99b6-4c1c-9390-92f55961627d', 'e6041335-48a9-421b-8edf-142b640bfccb'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b8bf18e9-486e-4532-846a-748faa0f187b tempest-CreateVolumesFromImageTest-954586148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b8bf18e9-486e-4532-846a-748faa0f187b tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-b8bf18e9-486e-4532-846a-748faa0f187b tempest-CreateVolumesFromImageTest-954586148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-b8bf18e9-486e-4532-846a-748faa0f187b tempest-CreateVolumesFromImageTest-954586148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b8bf18e9-486e-4532-846a-748faa0f187b tempest-CreateVolumesFromImageTest-954586148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b8bf18e9-486e-4532-846a-748faa0f187b tempest-CreateVolumesFromImageTest-954586148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:46 devstack sudo[88245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:46:46 devstack sudo[88245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0ed39c33-20a8-490e-a4cd-3061e4898ef7 tempest-VolumesExtendTest-263710970 None] Acquiring lock "cinder-99fab615-375e-4550-ba08-40253bd5e2c0-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0ed39c33-20a8-490e-a4cd-3061e4898ef7 tempest-VolumesExtendTest-263710970 None] Lock "cinder-99fab615-375e-4550-ba08-40253bd5e2c0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0ed39c33-20a8-490e-a4cd-3061e4898ef7 tempest-VolumesExtendTest-263710970 None] Acquiring lock "cinder-quobyte-99fab615-375e-4550-ba08-40253bd5e2c0" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0ed39c33-20a8-490e-a4cd-3061e4898ef7 tempest-VolumesExtendTest-263710970 None] Lock "cinder-quobyte-99fab615-375e-4550-ba08-40253bd5e2c0" acquired by "delete_volume" :: waited 0.020s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeee3a7e-87d4-4355-a66b-5cc42588ba8d]: (4, 'raw') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0ed39c33-20a8-490e-a4cd-3061e4898ef7 tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:47 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-2e230278-4acb-455e-a44b-8a483838081c tempest-VolumesListAdminTestJSON-1529682493 None] Acquiring lock "cinder-8bd31de0-0e2d-4872-86f1-f24adca1eaca-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:47 devstack sudo[88247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0 Apr 16 19:46:47 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:47 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-2e230278-4acb-455e-a44b-8a483838081c tempest-VolumesListAdminTestJSON-1529682493 None] Lock "cinder-8bd31de0-0e2d-4872-86f1-f24adca1eaca-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:47 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-2e230278-4acb-455e-a44b-8a483838081c tempest-VolumesListAdminTestJSON-1529682493 None] Acquiring lock "cinder-quobyte-8bd31de0-0e2d-4872-86f1-f24adca1eaca" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:47 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-2e230278-4acb-455e-a44b-8a483838081c tempest-VolumesListAdminTestJSON-1529682493 None] Lock "cinder-quobyte-8bd31de0-0e2d-4872-86f1-f24adca1eaca" acquired by "delete_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:47 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[187169a0-ffc3-43c8-97c5-e6b4e781f6ee]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2e230278-4acb-455e-a44b-8a483838081c tempest-VolumesListAdminTestJSON-1529682493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8bd31de0-0e2d-4872-86f1-f24adca1eaca {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:47 devstack sudo[88249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8bd31de0-0e2d-4872-86f1-f24adca1eaca Apr 16 19:46:47 devstack sudo[88249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:47 devstack sudo[88245]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b8bf18e9-486e-4532-846a-748faa0f187b tempest-CreateVolumesFromImageTest-954586148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.549s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:47 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-b8bf18e9-486e-4532-846a-748faa0f187b tempest-CreateVolumesFromImageTest-954586148 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:46:47 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-b8bf18e9-486e-4532-846a-748faa0f187b tempest-CreateVolumesFromImageTest-954586148 None] Deleted volume successfully. Apr 16 19:46:47 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b8bf18e9-486e-4532-846a-748faa0f187b tempest-CreateVolumesFromImageTest-954586148 None] Lock "cinder-5f62087a-03f1-40fe-97c5-ea1d47cfb5d2-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:47 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0ed39c33-20a8-490e-a4cd-3061e4898ef7 tempest-VolumesExtendTest-263710970 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0" returned: 0 in 0.613s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0ed39c33-20a8-490e-a4cd-3061e4898ef7 tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:47 devstack sudo[88254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0 Apr 16 19:46:47 devstack sudo[88254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:47 devstack sudo[88249]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2e230278-4acb-455e-a44b-8a483838081c tempest-VolumesListAdminTestJSON-1529682493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8bd31de0-0e2d-4872-86f1-f24adca1eaca" returned: 0 in 0.575s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2e230278-4acb-455e-a44b-8a483838081c tempest-VolumesListAdminTestJSON-1529682493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8bd31de0-0e2d-4872-86f1-f24adca1eaca {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:47 devstack sudo[88259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8bd31de0-0e2d-4872-86f1-f24adca1eaca Apr 16 19:46:47 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:48 devstack sudo[88254]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0ed39c33-20a8-490e-a4cd-3061e4898ef7 tempest-VolumesExtendTest-263710970 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0" returned: 1 in 0.562s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0ed39c33-20a8-490e-a4cd-3061e4898ef7 tempest-VolumesExtendTest-263710970 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0' failed. Not Retrying. {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 19:46:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0ed39c33-20a8-490e-a4cd-3061e4898ef7 tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:48 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:48 devstack sudo[88265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0 Apr 16 19:46:48 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2e230278-4acb-455e-a44b-8a483838081c tempest-VolumesListAdminTestJSON-1529682493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8bd31de0-0e2d-4872-86f1-f24adca1eaca" returned: 0 in 0.451s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-2e230278-4acb-455e-a44b-8a483838081c tempest-VolumesListAdminTestJSON-1529682493 None] Lock "cinder-quobyte-8bd31de0-0e2d-4872-86f1-f24adca1eaca" released by "delete_volume" :: held 1.054s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:48 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-2e230278-4acb-455e-a44b-8a483838081c tempest-VolumesListAdminTestJSON-1529682493 None] Created reservations ['a4971ded-e642-4aa9-baea-e0a8602d7b29', '08c86168-5834-44d3-ae92-83c628a39e5c', '0ec3b5d2-7e0f-40e2-a0ce-05f41c3f987d', '3892c00d-20fc-4a4f-a58c-194cc52b7bf5'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:46:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2e230278-4acb-455e-a44b-8a483838081c tempest-VolumesListAdminTestJSON-1529682493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2e230278-4acb-455e-a44b-8a483838081c tempest-VolumesListAdminTestJSON-1529682493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-2e230278-4acb-455e-a44b-8a483838081c tempest-VolumesListAdminTestJSON-1529682493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-2e230278-4acb-455e-a44b-8a483838081c tempest-VolumesListAdminTestJSON-1529682493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2e230278-4acb-455e-a44b-8a483838081c tempest-VolumesListAdminTestJSON-1529682493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2e230278-4acb-455e-a44b-8a483838081c tempest-VolumesListAdminTestJSON-1529682493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:48 devstack sudo[88267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:46:48 devstack sudo[88267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:48 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0ed39c33-20a8-490e-a4cd-3061e4898ef7 tempest-VolumesExtendTest-263710970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-99fab615-375e-4550-ba08-40253bd5e2c0" returned: 0 in 0.451s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0ed39c33-20a8-490e-a4cd-3061e4898ef7 tempest-VolumesExtendTest-263710970 None] Lock "cinder-quobyte-99fab615-375e-4550-ba08-40253bd5e2c0" released by "delete_volume" :: held 1.681s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:48 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-0ed39c33-20a8-490e-a4cd-3061e4898ef7 tempest-VolumesExtendTest-263710970 None] Created reservations ['356e0b04-e023-490b-a3d5-12765db55387', 'e2512348-0bf6-4871-b574-2b00b311b048', '29d59144-fe48-482b-a651-6cf205d16e32', 'f2b9431e-acff-4bed-882c-8c77063be1d7'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:46:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0ed39c33-20a8-490e-a4cd-3061e4898ef7 tempest-VolumesExtendTest-263710970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0ed39c33-20a8-490e-a4cd-3061e4898ef7 tempest-VolumesExtendTest-263710970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0ed39c33-20a8-490e-a4cd-3061e4898ef7 tempest-VolumesExtendTest-263710970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0ed39c33-20a8-490e-a4cd-3061e4898ef7 tempest-VolumesExtendTest-263710970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0ed39c33-20a8-490e-a4cd-3061e4898ef7 tempest-VolumesExtendTest-263710970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0ed39c33-20a8-490e-a4cd-3061e4898ef7 tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:48 devstack sudo[88271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:46:48 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:48 devstack sudo[88267]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2e230278-4acb-455e-a44b-8a483838081c tempest-VolumesListAdminTestJSON-1529682493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.506s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:48 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-2e230278-4acb-455e-a44b-8a483838081c tempest-VolumesListAdminTestJSON-1529682493 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:46:48 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-2e230278-4acb-455e-a44b-8a483838081c tempest-VolumesListAdminTestJSON-1529682493 None] Deleted volume successfully. Apr 16 19:46:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-2e230278-4acb-455e-a44b-8a483838081c tempest-VolumesListAdminTestJSON-1529682493 None] Lock "cinder-8bd31de0-0e2d-4872-86f1-f24adca1eaca-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:48 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Flow 'volume_create_manager' (f7e2ed7a-e470-4f40-a024-8377da5845f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7ce956-a32e-47b3-81a2-38aabfbc52a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7ce956-a32e-47b3-81a2-38aabfbc52a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-892070687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bcd90cbe46249b7af8ccd538362c6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:49Z,use_quota=True,user_id='7c5271d64e2f47c78dd480477ca94b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b555246-e9e6-4061-92ed-a03ca85cb6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b555246-e9e6-4061-92ed-a03ca85cb6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231c0efa-f7bc-446c-b582-b79b562cf229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231c0efa-f7bc-446c-b582-b79b562cf229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5', 'volume_name': 'volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e52585-9564-44df-a392-fb7dbc1a0469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e52585-9564-44df-a392-fb7dbc1a0469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81013573-a392-4ccf-ba56-5e69d7460458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:49 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Volume b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5', 'volume_size': 1} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-892070687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bcd90cbe46249b7af8ccd538362c6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:49Z,use_quota=True,user_id='7c5271d64e2f47c78dd480477ca94b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Creating volume b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:46:49 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:49 devstack sudo[88273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 1073741824 Apr 16 19:46:49 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:49 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0ed39c33-20a8-490e-a4cd-3061e4898ef7 tempest-VolumesExtendTest-263710970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.483s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-0ed39c33-20a8-490e-a4cd-3061e4898ef7 tempest-VolumesExtendTest-263710970 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:46:49 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-0ed39c33-20a8-490e-a4cd-3061e4898ef7 tempest-VolumesExtendTest-263710970 None] Deleted volume successfully. Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0ed39c33-20a8-490e-a4cd-3061e4898ef7 tempest-VolumesExtendTest-263710970 None] Lock "cinder-99fab615-375e-4550-ba08-40253bd5e2c0-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Flow 'volume_create_manager' (7931a6ba-767f-404d-9954-d16864cdb8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44967b1-2b2e-4032-a93a-c6d355ed6806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44967b1-2b2e-4032-a93a-c6d355ed6806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1262011226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6628d279-5cab-42d3-8694-7611feb1f7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f410fe4f665849a9aba96f6d1b1bd4dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:49Z,use_quota=True,user_id='740c980cf79d40b2ac620c3a801c13d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dcb0114-4b5d-4783-bf0d-81b485f9a5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dcb0114-4b5d-4783-bf0d-81b485f9a5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e843a99-ce3a-436a-8b10-2875476eaa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e843a99-ce3a-436a-8b10-2875476eaa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6628d279-5cab-42d3-8694-7611feb1f7ca', 'volume_name': 'volume-6628d279-5cab-42d3-8694-7611feb1f7ca', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc631881-82cb-4af2-b792-154bd39bf8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc631881-82cb-4af2-b792-154bd39bf8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc16854b-d804-4c6d-a415-68b4f20dd302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:49 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Volume 6628d279-5cab-42d3-8694-7611feb1f7ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6628d279-5cab-42d3-8694-7611feb1f7ca', 'volume_size': 1} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3dd54f6a-5752-4b66-a573-817bd68ee1f0 tempest-VolumesListAdminTestJSON-1529682493 None] Acquiring lock "cinder-87922a12-2b34-4317-be59-e44010cc7f86-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3dd54f6a-5752-4b66-a573-817bd68ee1f0 tempest-VolumesListAdminTestJSON-1529682493 None] Lock "cinder-87922a12-2b34-4317-be59-e44010cc7f86-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3dd54f6a-5752-4b66-a573-817bd68ee1f0 tempest-VolumesListAdminTestJSON-1529682493 None] Acquiring lock "cinder-quobyte-87922a12-2b34-4317-be59-e44010cc7f86" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3dd54f6a-5752-4b66-a573-817bd68ee1f0 tempest-VolumesListAdminTestJSON-1529682493 None] Lock "cinder-quobyte-87922a12-2b34-4317-be59-e44010cc7f86" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[00db7bb4-3d3f-4ad5-896b-68405d2122ab]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3dd54f6a-5752-4b66-a573-817bd68ee1f0 tempest-VolumesListAdminTestJSON-1529682493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-87922a12-2b34-4317-be59-e44010cc7f86 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:49 devstack sudo[88276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-87922a12-2b34-4317-be59-e44010cc7f86 Apr 16 19:46:49 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:49 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 1073741824" returned: 0 in 0.555s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:49 devstack sudo[88281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 Apr 16 19:46:49 devstack sudo[88281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:49 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3dd54f6a-5752-4b66-a573-817bd68ee1f0 tempest-VolumesListAdminTestJSON-1529682493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-87922a12-2b34-4317-be59-e44010cc7f86" returned: 0 in 0.497s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3dd54f6a-5752-4b66-a573-817bd68ee1f0 tempest-VolumesListAdminTestJSON-1529682493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-87922a12-2b34-4317-be59-e44010cc7f86 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:49 devstack sudo[88286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-87922a12-2b34-4317-be59-e44010cc7f86 Apr 16 19:46:49 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:50 devstack sudo[88281]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5" returned: 0 in 0.448s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.709s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1262011226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6628d279-5cab-42d3-8694-7611feb1f7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f410fe4f665849a9aba96f6d1b1bd4dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:49Z,use_quota=True,user_id='740c980cf79d40b2ac620c3a801c13d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Creating volume 6628d279-5cab-42d3-8694-7611feb1f7ca {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:46:50 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81013573-a392-4ccf-ba56-5e69d7460458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eecd019-ff31-4d33-85ee-1cc656407c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:50 devstack sudo[88289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca 1073741824 Apr 16 19:46:50 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:50 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Volume volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 (b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5): created successfully Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eecd019-ff31-4d33-85ee-1cc656407c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Flow 'volume_create_manager' (f7e2ed7a-e470-4f40-a024-8377da5845f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:50 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-0b61dd49-14e5-4f93-beab-19f91cf0b844 tempest-VolumeDependencyTests-1883253271 None] Created volume successfully. Apr 16 19:46:50 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3dd54f6a-5752-4b66-a573-817bd68ee1f0 tempest-VolumesListAdminTestJSON-1529682493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-87922a12-2b34-4317-be59-e44010cc7f86" returned: 0 in 0.450s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3dd54f6a-5752-4b66-a573-817bd68ee1f0 tempest-VolumesListAdminTestJSON-1529682493 None] Lock "cinder-quobyte-87922a12-2b34-4317-be59-e44010cc7f86" released by "delete_volume" :: held 0.969s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-3dd54f6a-5752-4b66-a573-817bd68ee1f0 tempest-VolumesListAdminTestJSON-1529682493 None] Created reservations ['2d0bd88f-21b7-4ccf-afa5-2949d09474ee', '45a28a8f-78f7-41f6-8062-510ec7410998', 'd4871ca8-2daa-4b97-b210-a27b68e4ea52', 'cbed0fa5-357e-459a-986f-edc1f04c3c5d'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3dd54f6a-5752-4b66-a573-817bd68ee1f0 tempest-VolumesListAdminTestJSON-1529682493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3dd54f6a-5752-4b66-a573-817bd68ee1f0 tempest-VolumesListAdminTestJSON-1529682493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3dd54f6a-5752-4b66-a573-817bd68ee1f0 tempest-VolumesListAdminTestJSON-1529682493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3dd54f6a-5752-4b66-a573-817bd68ee1f0 tempest-VolumesListAdminTestJSON-1529682493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3dd54f6a-5752-4b66-a573-817bd68ee1f0 tempest-VolumesListAdminTestJSON-1529682493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3dd54f6a-5752-4b66-a573-817bd68ee1f0 tempest-VolumesListAdminTestJSON-1529682493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:50 devstack sudo[88295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:46:50 devstack sudo[88295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:50 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca 1073741824" returned: 0 in 0.547s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:50 devstack sudo[88297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca Apr 16 19:46:50 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:50 devstack sudo[88295]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3dd54f6a-5752-4b66-a573-817bd68ee1f0 tempest-VolumesListAdminTestJSON-1529682493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.405s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-3dd54f6a-5752-4b66-a573-817bd68ee1f0 tempest-VolumesListAdminTestJSON-1529682493 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:46:50 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-3dd54f6a-5752-4b66-a573-817bd68ee1f0 tempest-VolumesListAdminTestJSON-1529682493 None] Deleted volume successfully. Apr 16 19:46:50 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3dd54f6a-5752-4b66-a573-817bd68ee1f0 tempest-VolumesListAdminTestJSON-1529682493 None] Lock "cinder-87922a12-2b34-4317-be59-e44010cc7f86-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:46:51 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca" returned: 0 in 0.447s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:51 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:46:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc16854b-d804-4c6d-a415-68b4f20dd302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6628d279-5cab-42d3-8694-7611feb1f7ca', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (328575a4-e6d3-42e9-8c9f-9de60f38344a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:51 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Volume volume-6628d279-5cab-42d3-8694-7611feb1f7ca (6628d279-5cab-42d3-8694-7611feb1f7ca): created successfully Apr 16 19:46:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (328575a4-e6d3-42e9-8c9f-9de60f38344a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Flow 'volume_create_manager' (7931a6ba-767f-404d-9954-d16864cdb8ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:51 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-e7c48f08-fe20-4299-a293-d8375ebcda48 tempest-VolumesExtendTest-263710970 None] Created volume successfully. Apr 16 19:46:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-80cadb7d-a6cd-4e5a-a29b-7b3ee12b382e tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-80cadb7d-a6cd-4e5a-a29b-7b3ee12b382e tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:51 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-80cadb7d-a6cd-4e5a-a29b-7b3ee12b382e tempest-VolumeDependencyTests-1883253271 None] Creating offline snapshot 48590ae2-510d-4ae5-9d19-a625f1ba7d32 of volume b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:46:51 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[56899a79-1f76-4482-ae5e-20e70e3196b1]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-80cadb7d-a6cd-4e5a-a29b-7b3ee12b382e tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:51 devstack sudo[88307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 Apr 16 19:46:51 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2b8edb28-7207-4121-a571-032be9b229fc tempest-VolumesExtendTest-263710970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:51 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-80cadb7d-a6cd-4e5a-a29b-7b3ee12b382e tempest-VolumeDependencyTests-1883253271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5" returned: 0 in 0.551s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-80cadb7d-a6cd-4e5a-a29b-7b3ee12b382e tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.48590ae2-510d-4ae5-9d19-a625f1ba7d32 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:51 devstack sudo[88312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.48590ae2-510d-4ae5-9d19-a625f1ba7d32 1G Apr 16 19:46:51 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:52 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-80cadb7d-a6cd-4e5a-a29b-7b3ee12b382e tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.48590ae2-510d-4ae5-9d19-a625f1ba7d32 1G" returned: 0 in 0.600s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-80cadb7d-a6cd-4e5a-a29b-7b3ee12b382e tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.48590ae2-510d-4ae5-9d19-a625f1ba7d32 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:52 devstack sudo[88318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.48590ae2-510d-4ae5-9d19-a625f1ba7d32 Apr 16 19:46:52 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:53 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-80cadb7d-a6cd-4e5a-a29b-7b3ee12b382e tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.48590ae2-510d-4ae5-9d19-a625f1ba7d32" returned: 0 in 0.567s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:53 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-80cadb7d-a6cd-4e5a-a29b-7b3ee12b382e tempest-VolumeDependencyTests-1883253271 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.48590ae2-510d-4ae5-9d19-a625f1ba7d32 is being set with open permissions: ugo+rw Apr 16 19:46:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-80cadb7d-a6cd-4e5a-a29b-7b3ee12b382e tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.48590ae2-510d-4ae5-9d19-a625f1ba7d32 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:53 devstack sudo[88323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.48590ae2-510d-4ae5-9d19-a625f1ba7d32 Apr 16 19:46:53 devstack sudo[88323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:53 devstack sudo[88323]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-80cadb7d-a6cd-4e5a-a29b-7b3ee12b382e tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.48590ae2-510d-4ae5-9d19-a625f1ba7d32" returned: 0 in 0.501s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:53 devstack cinder-volume[82569]: DEBUG dbcounter [-] [82569] Writing DB stats cinder:SELECT=163,cinder:UPDATE=241,cinder:INSERT=66,cinder:DELETE=25 {{(pid=82569) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:46:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-80cadb7d-a6cd-4e5a-a29b-7b3ee12b382e tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:53 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.info Apr 16 19:46:53 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:54 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-80cadb7d-a6cd-4e5a-a29b-7b3ee12b382e tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.info" returned: 0 in 0.485s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:54 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-80cadb7d-a6cd-4e5a-a29b-7b3ee12b382e tempest-VolumeDependencyTests-1883253271 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.info is being set with open permissions: ugo+rw Apr 16 19:46:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-80cadb7d-a6cd-4e5a-a29b-7b3ee12b382e tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:54 devstack sudo[88330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.info Apr 16 19:46:54 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:54 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:46:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Flow 'volume_create_manager' (52eb2b41-10c7-42da-8a17-df2ae12f67f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03cc785c-2454-45b2-9066-8924ba119bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03cc785c-2454-45b2-9066-8924ba119bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1415166797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2abef922-6189-41cc-a785-163f2b82d79b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1f915a1551488fa0a05b78462c0a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:54Z,use_quota=True,user_id='c67bccb1b84c43969bc0704a30bba0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9043448-130e-405f-8842-596c4283f9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9043448-130e-405f-8842-596c4283f9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b22e01a-10f8-47e8-9187-e6f2d8c338e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:54 devstack cinder-volume[82569]: DEBUG cinder.image.glance [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Creating Keystone auth plugin from conf {{(pid=82569) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 19:46:54 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-80cadb7d-a6cd-4e5a-a29b-7b3ee12b382e tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.info" returned: 0 in 0.468s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-80cadb7d-a6cd-4e5a-a29b-7b3ee12b382e tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.245s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2b8edb28-7207-4121-a571-032be9b229fc tempest-VolumesExtendTest-263710970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.929s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:54 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-2b8edb28-7207-4121-a571-032be9b229fc tempest-VolumesExtendTest-263710970 None] Creating offline snapshot ca2f8972-6427-4bac-91b5-a2b7a17aad14 of volume 6628d279-5cab-42d3-8694-7611feb1f7ca {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:46:54 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e08fec-48bd-4f45-87aa-30c73b5165b7]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2b8edb28-7207-4121-a571-032be9b229fc tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:54 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-80cadb7d-a6cd-4e5a-a29b-7b3ee12b382e tempest-VolumeDependencyTests-1883253271 None] Create snapshot completed successfully Apr 16 19:46:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b22e01a-10f8-47e8-9187-e6f2d8c338e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2abef922-6189-41cc-a785-163f2b82d79b', 'volume_name': 'volume-2abef922-6189-41cc-a785-163f2b82d79b', 'volume_size': 1, 'image_id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b20df0c408546a0a2fd4c69a0f4b468', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'created_at': datetime.datetime(2026, 4, 16, 17, 35, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 17, 35, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:54 devstack sudo[88333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca Apr 16 19:46:54 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e004261-cecc-4653-9dd7-90740a5f0f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e004261-cecc-4653-9dd7-90740a5f0f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3abaa78-27f3-43d1-bb31-6d8ee9a1aaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:54 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Volume 2abef922-6189-41cc-a785-163f2b82d79b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2abef922-6189-41cc-a785-163f2b82d79b', 'volume_size': 1, 'image_id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b20df0c408546a0a2fd4c69a0f4b468', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'created_at': datetime.datetime(2026, 4, 16, 17, 35, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 17, 35, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 19:46:54 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Trying to clone 2abef922-6189-41cc-a785-163f2b82d79b from image ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'metadata': {}}]). {{(pid=82569) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 19:46:54 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_klw0nfbhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82569) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 19:46:54 devstack cinder-volume[82569]: INFO cinder.image.image_utils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Image download 20.69 MB at 20.69 MB/s Apr 16 19:46:54 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5433aee-f1fa-46f3-8d66-3b5cc8484397]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_klw0nfbhdevstack@QuobyteHD {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:54 devstack sudo[88336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_klw0nfbhdevstack@QuobyteHD Apr 16 19:46:54 devstack sudo[88336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:55 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2b8edb28-7207-4121-a571-032be9b229fc tempest-VolumesExtendTest-263710970 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca" returned: 0 in 0.527s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2b8edb28-7207-4121-a571-032be9b229fc tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.ca2f8972-6427-4bac-91b5-a2b7a17aad14 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:55 devstack sudo[88341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.ca2f8972-6427-4bac-91b5-a2b7a17aad14 1G Apr 16 19:46:55 devstack sudo[88341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:55 devstack sudo[88336]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_klw0nfbhdevstack@QuobyteHD" returned: 0 in 0.486s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:55 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Temporary image ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 is fetched for user c67bccb1b84c43969bc0704a30bba0c5. {{(pid=82569) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 19:46:55 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[9538856c-c858-4258-8a3d-cc0fdf8d4178]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_klw0nfbhdevstack@QuobyteHD {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:55 devstack sudo[88349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_klw0nfbhdevstack@QuobyteHD Apr 16 19:46:55 devstack sudo[88349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:55 devstack sudo[88341]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2b8edb28-7207-4121-a571-032be9b229fc tempest-VolumesExtendTest-263710970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.ca2f8972-6427-4bac-91b5-a2b7a17aad14 1G" returned: 0 in 0.526s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2b8edb28-7207-4121-a571-032be9b229fc tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6628d279-5cab-42d3-8694-7611feb1f7ca -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.ca2f8972-6427-4bac-91b5-a2b7a17aad14 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:55 devstack sudo[88351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6628d279-5cab-42d3-8694-7611feb1f7ca -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.ca2f8972-6427-4bac-91b5-a2b7a17aad14 Apr 16 19:46:55 devstack sudo[88351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:55 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:46:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Flow 'volume_create_manager' (0783bc9b-81b5-4fad-8fc0-13ee0e2390b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:46:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a03583-03a8-40bf-8951-c634fa80891e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a03583-03a8-40bf-8951-c634fa80891e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-808725758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb096954-eaa1-478c-897b-e7aa8d9388a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bcd90cbe46249b7af8ccd538362c6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=48590ae2-510d-4ae5-9d19-a625f1ba7d32,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:56Z,use_quota=True,user_id='7c5271d64e2f47c78dd480477ca94b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e975b8ce-e98f-4922-aaa8-a6a288c79510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e975b8ce-e98f-4922-aaa8-a6a288c79510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b935eb-8401-4074-8a12-5874681e7d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b935eb-8401-4074-8a12-5874681e7d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'eb096954-eaa1-478c-897b-e7aa8d9388a0', 'volume_name': 'volume-eb096954-eaa1-478c-897b-e7aa8d9388a0', 'volume_size': 1, 'snapshot_id': '48590ae2-510d-4ae5-9d19-a625f1ba7d32'}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d19977-4202-4288-b0b7-b7a476b21a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d19977-4202-4288-b0b7-b7a476b21a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:46:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13937bce-01d9-4005-aca0-04bfb2c0457e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:46:55 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Volume eb096954-eaa1-478c-897b-e7aa8d9388a0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-eb096954-eaa1-478c-897b-e7aa8d9388a0', 'volume_size': 1, 'snapshot_id': '48590ae2-510d-4ae5-9d19-a625f1ba7d32'} Apr 16 19:46:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:56 devstack sudo[88351]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2b8edb28-7207-4121-a571-032be9b229fc tempest-VolumesExtendTest-263710970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6628d279-5cab-42d3-8694-7611feb1f7ca -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.ca2f8972-6427-4bac-91b5-a2b7a17aad14" returned: 0 in 0.445s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:56 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-2b8edb28-7207-4121-a571-032be9b229fc tempest-VolumesExtendTest-263710970 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.ca2f8972-6427-4bac-91b5-a2b7a17aad14 is being set with open permissions: ugo+rw Apr 16 19:46:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2b8edb28-7207-4121-a571-032be9b229fc tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.ca2f8972-6427-4bac-91b5-a2b7a17aad14 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:56 devstack sudo[88359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.ca2f8972-6427-4bac-91b5-a2b7a17aad14 Apr 16 19:46:56 devstack sudo[88359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:56 devstack sudo[88349]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_klw0nfbhdevstack@QuobyteHD" returned: 0 in 0.578s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:56 devstack sudo[88359]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2b8edb28-7207-4121-a571-032be9b229fc tempest-VolumesExtendTest-263710970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.ca2f8972-6427-4bac-91b5-a2b7a17aad14" returned: 0 in 0.425s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2b8edb28-7207-4121-a571-032be9b229fc tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:56 devstack sudo[88362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.info Apr 16 19:46:56 devstack sudo[88362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:56 devstack sudo[88362]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2b8edb28-7207-4121-a571-032be9b229fc tempest-VolumesExtendTest-263710970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.info" returned: 0 in 0.437s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:56 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-2b8edb28-7207-4121-a571-032be9b229fc tempest-VolumesExtendTest-263710970 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.info is being set with open permissions: ugo+rw Apr 16 19:46:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2b8edb28-7207-4121-a571-032be9b229fc tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:56 devstack sudo[88365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.info Apr 16 19:46:56 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:57 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2b8edb28-7207-4121-a571-032be9b229fc tempest-VolumesExtendTest-263710970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.info" returned: 0 in 0.480s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2b8edb28-7207-4121-a571-032be9b229fc tempest-VolumesExtendTest-263710970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.903s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.566s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "cinder-quobyte-48590ae2-510d-4ae5-9d19-a625f1ba7d32-eb096954-eaa1-478c-897b-e7aa8d9388a0" by "_create_volume_from_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-quobyte-48590ae2-510d-4ae5-9d19-a625f1ba7d32-eb096954-eaa1-478c-897b-e7aa8d9388a0" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:57 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Creating volume eb096954-eaa1-478c-897b-e7aa8d9388a0 from snapshot 48590ae2-510d-4ae5-9d19-a625f1ba7d32 {{(pid=82569) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 19:46:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:57 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:57 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:57 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:46:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "cinder-quobyte-eb096954-eaa1-478c-897b-e7aa8d9388a0" by "_copy_volume_from_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:46:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-quobyte-eb096954-eaa1-478c-897b-e7aa8d9388a0" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:46:57 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] snapshot: 48590ae2-510d-4ae5-9d19-a625f1ba7d32, volume: eb096954-eaa1-478c-897b-e7aa8d9388a0, {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 19:46:57 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-2b8edb28-7207-4121-a571-032be9b229fc tempest-VolumesExtendTest-263710970 None] Create snapshot completed successfully Apr 16 19:46:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:46:57 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:46:57 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:46:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:46:57 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf89093-5df4-4942-8c2f-96e17cc58eab]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.48590ae2-510d-4ae5-9d19-a625f1ba7d32 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:57 devstack sudo[88368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.48590ae2-510d-4ae5-9d19-a625f1ba7d32 Apr 16 19:46:57 devstack sudo[88368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-be4b56d3-c231-4898-b8fb-827af1773262 tempest-VolumesExtendTest-263710970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:46:58 devstack sudo[88368]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.48590ae2-510d-4ae5-9d19-a625f1ba7d32" returned: 0 in 0.518s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:58 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:46:58 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 19:46:58 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Creating direct copy from snapshot {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 19:46:58 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e19ea6-3717-4838-8f5a-72ccd10b92bf]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:46:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:58 devstack sudo[88373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 Apr 16 19:46:58 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:46:58 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root Apr 16 19:46:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5" returned: 0 in 0.519s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:46:58 devstack cinder-volume[82569]: DEBUG cinder.utils [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Path /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb096954-eaa1-478c-897b-e7aa8d9388a0 not found in is_blk_device check {{(pid=82569) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 19:46:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb096954-eaa1-478c-897b-e7aa8d9388a0 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:46:58 devstack sudo[88378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb096954-eaa1-478c-897b-e7aa8d9388a0 Apr 16 19:46:58 devstack sudo[88378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:00 devstack sudo[88378]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb096954-eaa1-478c-897b-e7aa8d9388a0" returned: 0 in 2.001s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:00 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f4a6f0-aaf9-465a-b461-65a8f3b2f128]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:00 devstack sudo[88391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 Apr 16 19:47:00 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:01 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5" returned: 0 in 0.625s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:01 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Image conversion details: src /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5, size 1024.00 MB, duration 2.00 sec, destination /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb096954-eaa1-478c-897b-e7aa8d9388a0 {{(pid=82569) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 19:47:01 devstack cinder-volume[82569]: INFO cinder.image.image_utils [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Converted 1024.00 MB image at 511.22 MB/s Apr 16 19:47:01 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb096954-eaa1-478c-897b-e7aa8d9388a0 is being set with open permissions: ugo+rw Apr 16 19:47:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb096954-eaa1-478c-897b-e7aa8d9388a0 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:01 devstack sudo[88396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb096954-eaa1-478c-897b-e7aa8d9388a0 Apr 16 19:47:01 devstack sudo[88396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:01 devstack sudo[88396]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb096954-eaa1-478c-897b-e7aa8d9388a0" returned: 0 in 0.431s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-quobyte-eb096954-eaa1-478c-897b-e7aa8d9388a0" released by "_copy_volume_from_snapshot" :: held 4.165s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-quobyte-48590ae2-510d-4ae5-9d19-a625f1ba7d32-eb096954-eaa1-478c-897b-e7aa8d9388a0" released by "_create_volume_from_snapshot" :: held 4.184s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.206s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.569s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:01 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1415166797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2abef922-6189-41cc-a785-163f2b82d79b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1f915a1551488fa0a05b78462c0a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:46:54Z,use_quota=True,user_id='c67bccb1b84c43969bc0704a30bba0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:47:01 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Creating volume 2abef922-6189-41cc-a785-163f2b82d79b {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:47:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:01 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:47:01 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:47:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:01 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:47:01 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:47:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:01 devstack sudo[88399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b 1073741824 Apr 16 19:47:01 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13937bce-01d9-4005-aca0-04bfb2c0457e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb096954-eaa1-478c-897b-e7aa8d9388a0', 'volume_size': 1, 'snapshot_id': '48590ae2-510d-4ae5-9d19-a625f1ba7d32'}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (601d42b6-38cc-42b5-b750-d82a0d12f053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:01 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Volume volume-eb096954-eaa1-478c-897b-e7aa8d9388a0 (eb096954-eaa1-478c-897b-e7aa8d9388a0): created successfully Apr 16 19:47:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (601d42b6-38cc-42b5-b750-d82a0d12f053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Flow 'volume_create_manager' (0783bc9b-81b5-4fad-8fc0-13ee0e2390b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:47:01 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-975481a9-5afe-4c7e-a0ad-de3c3f4b6b35 tempest-VolumeDependencyTests-1883253271 None] Created volume successfully. Apr 16 19:47:02 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b 1073741824" returned: 0 in 0.571s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:02 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-adcf119b-f937-42f7-b66e-2c67b48388ba tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "cinder-48590ae2-510d-4ae5-9d19-a625f1ba7d32-delete_snapshot" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:02 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-adcf119b-f937-42f7-b66e-2c67b48388ba tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-48590ae2-510d-4ae5-9d19-a625f1ba7d32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:02 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-adcf119b-f937-42f7-b66e-2c67b48388ba tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "cinder-quobyte-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:02 devstack sudo[88404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b Apr 16 19:47:02 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:02 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-adcf119b-f937-42f7-b66e-2c67b48388ba tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-quobyte-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:02 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-adcf119b-f937-42f7-b66e-2c67b48388ba tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "cinder-quobyte-48590ae2-510d-4ae5-9d19-a625f1ba7d32" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:02 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-adcf119b-f937-42f7-b66e-2c67b48388ba tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-quobyte-48590ae2-510d-4ae5-9d19-a625f1ba7d32" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:02 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-adcf119b-f937-42f7-b66e-2c67b48388ba tempest-VolumeDependencyTests-1883253271 None] Deleting offline snapshot 48590ae2-510d-4ae5-9d19-a625f1ba7d32 of volume b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:47:02 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-adcf119b-f937-42f7-b66e-2c67b48388ba tempest-VolumeDependencyTests-1883253271 None] snapshot_file for this snap is: volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.48590ae2-510d-4ae5-9d19-a625f1ba7d32 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:47:02 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[35797de4-1db4-4428-9de3-0b6601cede3e]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-adcf119b-f937-42f7-b66e-2c67b48388ba tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.48590ae2-510d-4ae5-9d19-a625f1ba7d32 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:02 devstack sudo[88406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.48590ae2-510d-4ae5-9d19-a625f1ba7d32 Apr 16 19:47:02 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:02 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b" returned: 0 in 0.453s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:02 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:47:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-be4b56d3-c231-4898-b8fb-827af1773262 tempest-VolumesExtendTest-263710970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 4.860s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:02 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b3fea7-2eaa-4d6f-8b2c-00a2236cc445]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-be4b56d3-c231-4898-b8fb-827af1773262 tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:02 devstack cinder-volume[82569]: DEBUG cinder.volume.volume_utils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Attempting download of ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'metadata': {}}])) to volume 2abef922-6189-41cc-a785-163f2b82d79b. {{(pid=82569) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 16 19:47:02 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82b700e-e953-4091-a5ad-d5b8f9a659a1]: (4, 'raw') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_d95svo1v {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:02 devstack sudo[88409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca Apr 16 19:47:02 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:02 devstack sudo[88413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_d95svo1v Apr 16 19:47:02 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:02 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-adcf119b-f937-42f7-b66e-2c67b48388ba tempest-VolumeDependencyTests-1883253271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.48590ae2-510d-4ae5-9d19-a625f1ba7d32" returned: 0 in 0.607s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:02 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-adcf119b-f937-42f7-b66e-2c67b48388ba tempest-VolumeDependencyTests-1883253271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:47:02 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a29c72a-4093-443a-a713-20a195110c33]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-adcf119b-f937-42f7-b66e-2c67b48388ba tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:03 devstack sudo[88416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 Apr 16 19:47:03 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:03 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-be4b56d3-c231-4898-b8fb-827af1773262 tempest-VolumesExtendTest-263710970 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca" returned: 0 in 0.596s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-be4b56d3-c231-4898-b8fb-827af1773262 tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.ca2f8972-6427-4bac-91b5-a2b7a17aad14 2G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:03 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_d95svo1v" returned: 0 in 0.601s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_d95svo1v {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-be4b56d3-c231-4898-b8fb-827af1773262 tempest-VolumesExtendTest-263710970 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.ca2f8972-6427-4bac-91b5-a2b7a17aad14 2G" returned: 0 in 0.118s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-be4b56d3-c231-4898-b8fb-827af1773262 tempest-VolumesExtendTest-263710970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.742s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:03 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-be4b56d3-c231-4898-b8fb-827af1773262 tempest-VolumesExtendTest-263710970 None] Extend volume completed successfully. Apr 16 19:47:03 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_d95svo1v Apr 16 19:47:03 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:03 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-adcf119b-f937-42f7-b66e-2c67b48388ba tempest-VolumeDependencyTests-1883253271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5" returned: 0 in 0.602s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-adcf119b-f937-42f7-b66e-2c67b48388ba tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.48590ae2-510d-4ae5-9d19-a625f1ba7d32 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:03 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.48590ae2-510d-4ae5-9d19-a625f1ba7d32 Apr 16 19:47:03 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:03 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_d95svo1v" returned: 1 in 0.543s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_d95svo1v' failed. Not Retrying. {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 19:47:03 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[70404074-ac6a-46c7-802e-37cff9e6b46b]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_klw0nfbhdevstack@QuobyteHD {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:04 devstack sudo[88436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_klw0nfbhdevstack@QuobyteHD Apr 16 19:47:04 devstack sudo[88436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG oslo_service.periodic_task [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82569) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:04 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-adcf119b-f937-42f7-b66e-2c67b48388ba tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.48590ae2-510d-4ae5-9d19-a625f1ba7d32" returned: 0 in 0.560s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-adcf119b-f937-42f7-b66e-2c67b48388ba tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.48590ae2-510d-4ae5-9d19-a625f1ba7d32 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:04 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:47:04 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:04 devstack sudo[88442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.48590ae2-510d-4ae5-9d19-a625f1ba7d32 Apr 16 19:47:04 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9d36a560-2ce3-45c8-811c-6f510f31f3f1 tempest-VolumesExtendTest-263710970 None] Acquiring lock "cinder-ca2f8972-6427-4bac-91b5-a2b7a17aad14-delete_snapshot" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9d36a560-2ce3-45c8-811c-6f510f31f3f1 tempest-VolumesExtendTest-263710970 None] Lock "cinder-ca2f8972-6427-4bac-91b5-a2b7a17aad14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9d36a560-2ce3-45c8-811c-6f510f31f3f1 tempest-VolumesExtendTest-263710970 None] Acquiring lock "cinder-quobyte-6628d279-5cab-42d3-8694-7611feb1f7ca" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9d36a560-2ce3-45c8-811c-6f510f31f3f1 tempest-VolumesExtendTest-263710970 None] Lock "cinder-quobyte-6628d279-5cab-42d3-8694-7611feb1f7ca" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9d36a560-2ce3-45c8-811c-6f510f31f3f1 tempest-VolumesExtendTest-263710970 None] Acquiring lock "cinder-quobyte-ca2f8972-6427-4bac-91b5-a2b7a17aad14" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9d36a560-2ce3-45c8-811c-6f510f31f3f1 tempest-VolumesExtendTest-263710970 None] Lock "cinder-quobyte-ca2f8972-6427-4bac-91b5-a2b7a17aad14" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-9d36a560-2ce3-45c8-811c-6f510f31f3f1 tempest-VolumesExtendTest-263710970 None] Deleting offline snapshot ca2f8972-6427-4bac-91b5-a2b7a17aad14 of volume 6628d279-5cab-42d3-8694-7611feb1f7ca {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-9d36a560-2ce3-45c8-811c-6f510f31f3f1 tempest-VolumesExtendTest-263710970 None] snapshot_file for this snap is: volume-6628d279-5cab-42d3-8694-7611feb1f7ca.ca2f8972-6427-4bac-91b5-a2b7a17aad14 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75e6058-ae1a-4597-8643-9dd9303333d7]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9d36a560-2ce3-45c8-811c-6f510f31f3f1 tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.ca2f8972-6427-4bac-91b5-a2b7a17aad14 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:04 devstack sudo[88436]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_klw0nfbhdevstack@QuobyteHD" returned: 0 in 0.642s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 was qcow2, converting to raw {{(pid=82569) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 19:47:04 devstack sudo[88449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.ca2f8972-6427-4bac-91b5-a2b7a17aad14 Apr 16 19:47:04 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_klw0nfbhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:04 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.494s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:47:04 devstack sudo[88452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_klw0nfbhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b Apr 16 19:47:04 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:04 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-adcf119b-f937-42f7-b66e-2c67b48388ba tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5.48590ae2-510d-4ae5-9d19-a625f1ba7d32" returned: 0 in 0.544s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-adcf119b-f937-42f7-b66e-2c67b48388ba tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-quobyte-48590ae2-510d-4ae5-9d19-a625f1ba7d32" released by "_delete_snapshot" :: held 2.381s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-adcf119b-f937-42f7-b66e-2c67b48388ba tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-quobyte-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5" released by "delete_snapshot" :: held 2.396s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-adcf119b-f937-42f7-b66e-2c67b48388ba tempest-VolumeDependencyTests-1883253271 None] Created reservations ['836cda96-1193-46c9-870b-b81f2befd59e', 'e74f4979-9a10-41ca-807b-fc241c790fc2', '0824db63-5870-459b-8059-bf0101ee5d75', '0e27af30-9a07-4586-8115-77400cc0f96c'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:47:04 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-adcf119b-f937-42f7-b66e-2c67b48388ba tempest-VolumeDependencyTests-1883253271 None] Delete snapshot completed successfully. Apr 16 19:47:04 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-adcf119b-f937-42f7-b66e-2c67b48388ba tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-48590ae2-510d-4ae5-9d19-a625f1ba7d32-delete_snapshot" released by "delete_snapshot" :: held 2.499s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:05 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9d36a560-2ce3-45c8-811c-6f510f31f3f1 tempest-VolumesExtendTest-263710970 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.ca2f8972-6427-4bac-91b5-a2b7a17aad14" returned: 0 in 0.568s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:05 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-9d36a560-2ce3-45c8-811c-6f510f31f3f1 tempest-VolumesExtendTest-263710970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6628d279-5cab-42d3-8694-7611feb1f7ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:47:05 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e91005-71a0-401a-b16a-721d15482a58]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9d36a560-2ce3-45c8-811c-6f510f31f3f1 tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:05 devstack sudo[88471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca Apr 16 19:47:05 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:05 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1505a861-73d1-4fbd-a252-0c42020f53c7 tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "cinder-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:05 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1505a861-73d1-4fbd-a252-0c42020f53c7 tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:05 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1505a861-73d1-4fbd-a252-0c42020f53c7 tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "cinder-quobyte-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:05 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1505a861-73d1-4fbd-a252-0c42020f53c7 tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-quobyte-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:05 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[783f7b27-2687-4346-a5ce-cdfa1d19117a]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1505a861-73d1-4fbd-a252-0c42020f53c7 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:05 devstack sudo[88473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 Apr 16 19:47:05 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:05 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9d36a560-2ce3-45c8-811c-6f510f31f3f1 tempest-VolumesExtendTest-263710970 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca" returned: 0 in 0.552s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9d36a560-2ce3-45c8-811c-6f510f31f3f1 tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.ca2f8972-6427-4bac-91b5-a2b7a17aad14 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:05 devstack sudo[88478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.ca2f8972-6427-4bac-91b5-a2b7a17aad14 Apr 16 19:47:05 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:05 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_klw0nfbhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b" returned: 0 in 1.110s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:05 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_klw0nfbhdevstack@QuobyteHD, size 112.00 MB, duration 1.11 sec, destination /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b {{(pid=82569) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 19:47:05 devstack cinder-volume[82569]: INFO cinder.image.image_utils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Converted 112.00 MB image at 100.74 MB/s Apr 16 19:47:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:05 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b 1G Apr 16 19:47:05 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:06 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1505a861-73d1-4fbd-a252-0c42020f53c7 tempest-VolumeDependencyTests-1883253271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5" returned: 0 in 0.532s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1505a861-73d1-4fbd-a252-0c42020f53c7 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:06 devstack sudo[88490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5 Apr 16 19:47:06 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:06 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b 1G" returned: 0 in 0.448s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:06 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ca61b5-f9a6-4267-a6b5-636f2b64c78f]: (4, 'raw') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:06 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9d36a560-2ce3-45c8-811c-6f510f31f3f1 tempest-VolumesExtendTest-263710970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.ca2f8972-6427-4bac-91b5-a2b7a17aad14" returned: 0 in 0.557s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9d36a560-2ce3-45c8-811c-6f510f31f3f1 tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.ca2f8972-6427-4bac-91b5-a2b7a17aad14 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:06 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.ca2f8972-6427-4bac-91b5-a2b7a17aad14 Apr 16 19:47:06 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:06 devstack sudo[88493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b Apr 16 19:47:06 devstack sudo[88493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:06 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1505a861-73d1-4fbd-a252-0c42020f53c7 tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5" returned: 0 in 0.509s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:06 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1505a861-73d1-4fbd-a252-0c42020f53c7 tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-quobyte-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5" released by "delete_volume" :: held 1.078s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:06 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-1505a861-73d1-4fbd-a252-0c42020f53c7 tempest-VolumeDependencyTests-1883253271 None] Created reservations ['cf1d8a66-bd06-4afa-9dff-9195ad04b9c2', '6e1d9006-32a0-4756-ba40-7536a9eb51b2', 'a59623c1-e14e-49ed-9925-53e0b5336365', 'edc63088-4b97-4262-a0c3-db9c1999bc0d'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:47:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1505a861-73d1-4fbd-a252-0c42020f53c7 tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1505a861-73d1-4fbd-a252-0c42020f53c7 tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:06 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1505a861-73d1-4fbd-a252-0c42020f53c7 tempest-VolumeDependencyTests-1883253271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:47:06 devstack sudo[88493]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:06 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1505a861-73d1-4fbd-a252-0c42020f53c7 tempest-VolumeDependencyTests-1883253271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:47:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1505a861-73d1-4fbd-a252-0c42020f53c7 tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1505a861-73d1-4fbd-a252-0c42020f53c7 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:06 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b" returned: 0 in 0.523s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:06 devstack sudo[88501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:47:06 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9d36a560-2ce3-45c8-811c-6f510f31f3f1 tempest-VolumesExtendTest-263710970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca.ca2f8972-6427-4bac-91b5-a2b7a17aad14" returned: 0 in 0.507s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:06 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9d36a560-2ce3-45c8-811c-6f510f31f3f1 tempest-VolumesExtendTest-263710970 None] Lock "cinder-quobyte-ca2f8972-6427-4bac-91b5-a2b7a17aad14" released by "_delete_snapshot" :: held 2.260s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:06 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9d36a560-2ce3-45c8-811c-6f510f31f3f1 tempest-VolumesExtendTest-263710970 None] Lock "cinder-quobyte-6628d279-5cab-42d3-8694-7611feb1f7ca" released by "delete_snapshot" :: held 2.298s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:06 devstack sudo[88502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b Apr 16 19:47:06 devstack sudo[88502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:06 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-9d36a560-2ce3-45c8-811c-6f510f31f3f1 tempest-VolumesExtendTest-263710970 None] Created reservations ['b921ec3f-82a1-44d5-9077-a3517e25d587', 'fd689e72-0c47-40f7-a33e-12bed2a11df7', '5bd65ec6-3bbc-4068-95c7-b559e4af13b4', 'f23fe7e6-c06c-4543-b7d3-958d7ffa9ef0'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:47:06 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-9d36a560-2ce3-45c8-811c-6f510f31f3f1 tempest-VolumesExtendTest-263710970 None] Delete snapshot completed successfully. Apr 16 19:47:06 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9d36a560-2ce3-45c8-811c-6f510f31f3f1 tempest-VolumesExtendTest-263710970 None] Lock "cinder-ca2f8972-6427-4bac-91b5-a2b7a17aad14-delete_snapshot" released by "delete_snapshot" :: held 2.399s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:07 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1505a861-73d1-4fbd-a252-0c42020f53c7 tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.441s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-1505a861-73d1-4fbd-a252-0c42020f53c7 tempest-VolumeDependencyTests-1883253271 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:47:07 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-1505a861-73d1-4fbd-a252-0c42020f53c7 tempest-VolumeDependencyTests-1883253271 None] Deleted volume successfully. Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1505a861-73d1-4fbd-a252-0c42020f53c7 tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-b5eb2957-a9a7-4a63-9d20-c9a7eb695ac5-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:07 devstack sudo[88502]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b" returned: 1 in 0.543s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b' failed. Not Retrying. {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG cinder.volume.volume_utils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Downloaded image ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'metadata': {}}])) to volume 2abef922-6189-41cc-a785-163f2b82d79b successfully. {{(pid=82569) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Temporary image ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 for user c67bccb1b84c43969bc0704a30bba0c5 is deleted. {{(pid=82569) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG cinder.volume.volume_utils [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Marking volume 2abef922-6189-41cc-a785-163f2b82d79b as bootable. {{(pid=82569) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Copying metadata from image ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 to 2abef922-6189-41cc-a785-163f2b82d79b. {{(pid=82569) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Creating volume glance metadata for volume 2abef922-6189-41cc-a785-163f2b82d79b backed by image ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82569) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3abaa78-27f3-43d1-bb31-6d8ee9a1aaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2abef922-6189-41cc-a785-163f2b82d79b', 'volume_size': 1, 'image_id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b20df0c408546a0a2fd4c69a0f4b468', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'created_at': datetime.datetime(2026, 4, 16, 17, 35, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 17, 35, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e4d2bf-d7e2-4b61-ba1e-44c8ee1450a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:07 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Volume volume-2abef922-6189-41cc-a785-163f2b82d79b (2abef922-6189-41cc-a785-163f2b82d79b): created successfully Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e4d2bf-d7e2-4b61-ba1e-44c8ee1450a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Flow 'volume_create_manager' (52eb2b41-10c7-42da-8a17-df2ae12f67f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:47:07 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-9f0706e0-ffbc-436e-bd62-973332dd3677 tempest-VolumesImageMetadata-841145902 None] Created volume successfully. Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e3b5142e-4a58-46c9-bd00-4140189d6922 tempest-VolumesExtendTest-263710970 None] Acquiring lock "cinder-6628d279-5cab-42d3-8694-7611feb1f7ca-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e3b5142e-4a58-46c9-bd00-4140189d6922 tempest-VolumesExtendTest-263710970 None] Lock "cinder-6628d279-5cab-42d3-8694-7611feb1f7ca-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e3b5142e-4a58-46c9-bd00-4140189d6922 tempest-VolumesExtendTest-263710970 None] Acquiring lock "cinder-quobyte-6628d279-5cab-42d3-8694-7611feb1f7ca" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e3b5142e-4a58-46c9-bd00-4140189d6922 tempest-VolumesExtendTest-263710970 None] Lock "cinder-quobyte-6628d279-5cab-42d3-8694-7611feb1f7ca" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7a4fcc-ae66-45f4-9c1c-9f0d0cb2c237]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e3b5142e-4a58-46c9-bd00-4140189d6922 tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:07 devstack sudo[88509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca Apr 16 19:47:07 devstack sudo[88509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Flow 'volume_create_manager' (832478d3-db09-4275-bc05-2138669af6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f9882f-8579-4599-867e-480ae48a2bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f9882f-8579-4599-867e-480ae48a2bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1414900534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3959e018-da5d-4e2e-acb7-10bf89d9d8ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bcd90cbe46249b7af8ccd538362c6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:08Z,use_quota=True,user_id='7c5271d64e2f47c78dd480477ca94b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3d5ef3-12ab-49f8-abb5-56188839c9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3d5ef3-12ab-49f8-abb5-56188839c9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58706d4e-913f-4e6d-b707-c0d72dacf8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58706d4e-913f-4e6d-b707-c0d72dacf8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3959e018-da5d-4e2e-acb7-10bf89d9d8ed', 'volume_name': 'volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae8d0764-88e9-4fe3-8b47-57bf3a9e3c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae8d0764-88e9-4fe3-8b47-57bf3a9e3c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:07 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf36ecf-beec-454a-99db-0772c805651c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:07 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Volume 3959e018-da5d-4e2e-acb7-10bf89d9d8ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed', 'volume_size': 1} Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1414900534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3959e018-da5d-4e2e-acb7-10bf89d9d8ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bcd90cbe46249b7af8ccd538362c6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:08Z,use_quota=True,user_id='7c5271d64e2f47c78dd480477ca94b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Creating volume 3959e018-da5d-4e2e-acb7-10bf89d9d8ed {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:47:08 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:08 devstack sudo[88511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed 1073741824 Apr 16 19:47:08 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:08 devstack sudo[88509]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e3b5142e-4a58-46c9-bd00-4140189d6922 tempest-VolumesExtendTest-263710970 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca" returned: 0 in 0.552s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e3b5142e-4a58-46c9-bd00-4140189d6922 tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:08 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca Apr 16 19:47:08 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-4e8e4bfe-74c0-4ebe-9cc7-99054e37b3e9 tempest-VolumesImageMetadata-841145902 None] Acquiring lock "cinder-2abef922-6189-41cc-a785-163f2b82d79b-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-4e8e4bfe-74c0-4ebe-9cc7-99054e37b3e9 tempest-VolumesImageMetadata-841145902 None] Lock "cinder-2abef922-6189-41cc-a785-163f2b82d79b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-4e8e4bfe-74c0-4ebe-9cc7-99054e37b3e9 tempest-VolumesImageMetadata-841145902 None] Acquiring lock "cinder-quobyte-2abef922-6189-41cc-a785-163f2b82d79b" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-4e8e4bfe-74c0-4ebe-9cc7-99054e37b3e9 tempest-VolumesImageMetadata-841145902 None] Lock "cinder-quobyte-2abef922-6189-41cc-a785-163f2b82d79b" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d52de12-e41b-4def-86c0-4aa22d256ba8]: (4, 'raw') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-4e8e4bfe-74c0-4ebe-9cc7-99054e37b3e9 tempest-VolumesImageMetadata-841145902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:08 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed 1073741824" returned: 0 in 0.569s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:08 devstack sudo[88522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed Apr 16 19:47:08 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:08 devstack sudo[88521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b Apr 16 19:47:08 devstack sudo[88521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:08 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e3b5142e-4a58-46c9-bd00-4140189d6922 tempest-VolumesExtendTest-263710970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6628d279-5cab-42d3-8694-7611feb1f7ca" returned: 0 in 0.496s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e3b5142e-4a58-46c9-bd00-4140189d6922 tempest-VolumesExtendTest-263710970 None] Lock "cinder-quobyte-6628d279-5cab-42d3-8694-7611feb1f7ca" released by "delete_volume" :: held 1.085s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-e3b5142e-4a58-46c9-bd00-4140189d6922 tempest-VolumesExtendTest-263710970 None] Created reservations ['8c4e838d-d056-4391-b6fb-a08602c74f51', 'e05cf661-15fd-4110-ac48-8da497482011', '0c8f661a-9a5c-4db5-ad50-3b7a94e4c8f9', 'bc28eab6-2f5e-4d62-8b9f-a4131f87ab2d'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e3b5142e-4a58-46c9-bd00-4140189d6922 tempest-VolumesExtendTest-263710970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e3b5142e-4a58-46c9-bd00-4140189d6922 tempest-VolumesExtendTest-263710970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e3b5142e-4a58-46c9-bd00-4140189d6922 tempest-VolumesExtendTest-263710970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e3b5142e-4a58-46c9-bd00-4140189d6922 tempest-VolumesExtendTest-263710970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e3b5142e-4a58-46c9-bd00-4140189d6922 tempest-VolumesExtendTest-263710970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e3b5142e-4a58-46c9-bd00-4140189d6922 tempest-VolumesExtendTest-263710970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:08 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:47:08 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:09 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed" returned: 0 in 0.466s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:09 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:47:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf36ecf-beec-454a-99db-0772c805651c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9d8a63-c594-4f86-92a1-0fb0afe429cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:09 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Volume volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed (3959e018-da5d-4e2e-acb7-10bf89d9d8ed): created successfully Apr 16 19:47:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9d8a63-c594-4f86-92a1-0fb0afe429cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Flow 'volume_create_manager' (832478d3-db09-4275-bc05-2138669af6b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:47:09 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-e7121101-a42f-4d2b-afe7-4ca2fcd6228d tempest-VolumeDependencyTests-1883253271 None] Created volume successfully. Apr 16 19:47:09 devstack sudo[88521]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-4e8e4bfe-74c0-4ebe-9cc7-99054e37b3e9 tempest-VolumesImageMetadata-841145902 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b" returned: 0 in 0.560s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-4e8e4bfe-74c0-4ebe-9cc7-99054e37b3e9 tempest-VolumesImageMetadata-841145902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:09 devstack sudo[88531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b Apr 16 19:47:09 devstack sudo[88531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:09 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e3b5142e-4a58-46c9-bd00-4140189d6922 tempest-VolumesExtendTest-263710970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.425s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:09 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-e3b5142e-4a58-46c9-bd00-4140189d6922 tempest-VolumesExtendTest-263710970 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:47:09 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-e3b5142e-4a58-46c9-bd00-4140189d6922 tempest-VolumesExtendTest-263710970 None] Deleted volume successfully. Apr 16 19:47:09 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e3b5142e-4a58-46c9-bd00-4140189d6922 tempest-VolumesExtendTest-263710970 None] Lock "cinder-6628d279-5cab-42d3-8694-7611feb1f7ca-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:09 devstack sudo[88531]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-4e8e4bfe-74c0-4ebe-9cc7-99054e37b3e9 tempest-VolumesImageMetadata-841145902 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b" returned: 1 in 0.513s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-4e8e4bfe-74c0-4ebe-9cc7-99054e37b3e9 tempest-VolumesImageMetadata-841145902 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b' failed. Not Retrying. {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 19:47:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-4e8e4bfe-74c0-4ebe-9cc7-99054e37b3e9 tempest-VolumesImageMetadata-841145902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:09 devstack sudo[88539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b Apr 16 19:47:09 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:10 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-4e8e4bfe-74c0-4ebe-9cc7-99054e37b3e9 tempest-VolumesImageMetadata-841145902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2abef922-6189-41cc-a785-163f2b82d79b" returned: 0 in 0.492s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-4e8e4bfe-74c0-4ebe-9cc7-99054e37b3e9 tempest-VolumesImageMetadata-841145902 None] Lock "cinder-quobyte-2abef922-6189-41cc-a785-163f2b82d79b" released by "delete_volume" :: held 1.604s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-4e8e4bfe-74c0-4ebe-9cc7-99054e37b3e9 tempest-VolumesImageMetadata-841145902 None] Created reservations ['b34b5c80-ad21-46c6-87c8-1707bd1be786', 'a739ba18-d678-4915-9540-dcc8902176ef', '10eae9ac-61ab-4c84-8e66-aedaceb41383', '42643cd8-4cfc-480b-b696-43762629f611'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-4e8e4bfe-74c0-4ebe-9cc7-99054e37b3e9 tempest-VolumesImageMetadata-841145902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-4e8e4bfe-74c0-4ebe-9cc7-99054e37b3e9 tempest-VolumesImageMetadata-841145902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-4e8e4bfe-74c0-4ebe-9cc7-99054e37b3e9 tempest-VolumesImageMetadata-841145902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-4e8e4bfe-74c0-4ebe-9cc7-99054e37b3e9 tempest-VolumesImageMetadata-841145902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-4e8e4bfe-74c0-4ebe-9cc7-99054e37b3e9 tempest-VolumesImageMetadata-841145902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-4e8e4bfe-74c0-4ebe-9cc7-99054e37b3e9 tempest-VolumesImageMetadata-841145902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:10 devstack sudo[88542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:47:10 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Flow 'volume_create_manager' (d9aa5623-b488-4295-a670-7c3b13a9014a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9279bfe-b98a-47b5-8b44-1c4de1c54d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9279bfe-b98a-47b5-8b44-1c4de1c54d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1419124644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea79e81-af52-43ca-b1e9-1e6f238bc35d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bcd90cbe46249b7af8ccd538362c6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3959e018-da5d-4e2e-acb7-10bf89d9d8ed,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:10Z,use_quota=True,user_id='7c5271d64e2f47c78dd480477ca94b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f971cc4-ad66-48de-b8c1-2040fd1583a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f971cc4-ad66-48de-b8c1-2040fd1583a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e50b24f7-5dba-4e18-9edd-b5b60d4c928b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e50b24f7-5dba-4e18-9edd-b5b60d4c928b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'eea79e81-af52-43ca-b1e9-1e6f238bc35d', 'volume_name': 'volume-eea79e81-af52-43ca-b1e9-1e6f238bc35d', 'volume_size': 1, 'source_volid': '3959e018-da5d-4e2e-acb7-10bf89d9d8ed', 'source_volstatus': 'available'}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83234152-f5bc-4ff7-942b-81872eb51338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83234152-f5bc-4ff7-942b-81872eb51338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e609199-244a-4ee2-a79e-94806cacf430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:10 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Volume eea79e81-af52-43ca-b1e9-1e6f238bc35d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-eea79e81-af52-43ca-b1e9-1e6f238bc35d', 'volume_size': 1, 'source_volid': '3959e018-da5d-4e2e-acb7-10bf89d9d8ed', 'source_volstatus': 'available'} Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:10 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Cloning volume 3959e018-da5d-4e2e-acb7-10bf89d9d8ed to volume eea79e81-af52-43ca-b1e9-1e6f238bc35d Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Creating offline snapshot 08f6b4c2-9f06-4727-a70c-c5af2c260a82 of volume 3959e018-da5d-4e2e-acb7-10bf89d9d8ed {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfc3609-21fa-406e-b579-b0a3883d2978]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:10 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed Apr 16 19:47:10 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:10 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-4e8e4bfe-74c0-4ebe-9cc7-99054e37b3e9 tempest-VolumesImageMetadata-841145902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.609s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-4e8e4bfe-74c0-4ebe-9cc7-99054e37b3e9 tempest-VolumesImageMetadata-841145902 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:47:10 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-4e8e4bfe-74c0-4ebe-9cc7-99054e37b3e9 tempest-VolumesImageMetadata-841145902 None] Deleted volume successfully. Apr 16 19:47:10 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-4e8e4bfe-74c0-4ebe-9cc7-99054e37b3e9 tempest-VolumesImageMetadata-841145902 None] Lock "cinder-2abef922-6189-41cc-a785-163f2b82d79b-delete_volume" released by "delete_volume" :: held 2.395s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:11 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed" returned: 0 in 0.683s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.08f6b4c2-9f06-4727-a70c-c5af2c260a82 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:11 devstack sudo[88550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.08f6b4c2-9f06-4727-a70c-c5af2c260a82 1G Apr 16 19:47:11 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:11 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.08f6b4c2-9f06-4727-a70c-c5af2c260a82 1G" returned: 0 in 0.731s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.08f6b4c2-9f06-4727-a70c-c5af2c260a82 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:12 devstack sudo[88589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.08f6b4c2-9f06-4727-a70c-c5af2c260a82 Apr 16 19:47:12 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:12 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.08f6b4c2-9f06-4727-a70c-c5af2c260a82" returned: 0 in 0.625s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:12 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.08f6b4c2-9f06-4727-a70c-c5af2c260a82 is being set with open permissions: ugo+rw Apr 16 19:47:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.08f6b4c2-9f06-4727-a70c-c5af2c260a82 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:12 devstack sudo[88594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.08f6b4c2-9f06-4727-a70c-c5af2c260a82 Apr 16 19:47:12 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:13 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.08f6b4c2-9f06-4727-a70c-c5af2c260a82" returned: 0 in 0.505s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:13 devstack sudo[88597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.info Apr 16 19:47:13 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:13 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:47:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Flow 'volume_create_manager' (364f3489-4d52-4a25-9ef8-8b85d436b537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:47:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d8a023-9cfc-4126-9cb7-0b7e3170c122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d8a023-9cfc-4126-9cb7-0b7e3170c122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-122256257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74449aeb-27f9-4d11-b02b-58006bf32ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f14c8329ec1d4d11a6d9a8246fa0929e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:13Z,use_quota=True,user_id='ee4959e482b04752bf4849114192d498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d5df55a-5fef-45b1-ab8b-b09c0c7838eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d5df55a-5fef-45b1-ab8b-b09c0c7838eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (322cff5b-5ee4-483f-9e9a-05004b8fbb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (322cff5b-5ee4-483f-9e9a-05004b8fbb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74449aeb-27f9-4d11-b02b-58006bf32ee6', 'volume_name': 'volume-74449aeb-27f9-4d11-b02b-58006bf32ee6', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6510df73-3ce7-445f-b753-9fc645aa2ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6510df73-3ce7-445f-b753-9fc645aa2ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d49afac-da95-4dd0-ac22-c22511ff258d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:13 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Volume 74449aeb-27f9-4d11-b02b-58006bf32ee6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74449aeb-27f9-4d11-b02b-58006bf32ee6', 'volume_size': 1} Apr 16 19:47:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:13 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.info" returned: 0 in 0.595s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:13 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.info is being set with open permissions: ugo+rw Apr 16 19:47:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:13 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.info Apr 16 19:47:13 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:14 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.info" returned: 0 in 0.459s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:14 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "cinder-quobyte-eea79e81-af52-43ca-b1e9-1e6f238bc35d" by "_copy_volume_from_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:14 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-quobyte-eea79e81-af52-43ca-b1e9-1e6f238bc35d" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] snapshot: 08f6b4c2-9f06-4727-a70c-c5af2c260a82, volume: eea79e81-af52-43ca-b1e9-1e6f238bc35d, {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 19:47:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:47:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:47:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:14 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[65233892-30e2-4e50-a005-15de0e25e054]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.08f6b4c2-9f06-4727-a70c-c5af2c260a82 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:14 devstack sudo[88604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.08f6b4c2-9f06-4727-a70c-c5af2c260a82 Apr 16 19:47:14 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:14 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.08f6b4c2-9f06-4727-a70c-c5af2c260a82" returned: 0 in 0.545s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:47:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 19:47:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Creating direct copy from snapshot {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 19:47:14 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f253be-1529-47ee-b8b4-4f64c845b971]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:14 devstack sudo[88609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed Apr 16 19:47:14 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:15 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed" returned: 0 in 0.597s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:15 devstack cinder-volume[82569]: DEBUG cinder.utils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Path /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eea79e81-af52-43ca-b1e9-1e6f238bc35d not found in is_blk_device check {{(pid=82569) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 19:47:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eea79e81-af52-43ca-b1e9-1e6f238bc35d {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:15 devstack sudo[88614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eea79e81-af52-43ca-b1e9-1e6f238bc35d Apr 16 19:47:15 devstack sudo[88614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:17 devstack sudo[88614]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eea79e81-af52-43ca-b1e9-1e6f238bc35d" returned: 0 in 2.559s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:17 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[555d5b57-806f-47a2-a508-7cb28f25a5d2]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:18 devstack sudo[88626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed Apr 16 19:47:18 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:18 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed" returned: 0 in 0.677s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:18 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Image conversion details: src /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed, size 1024.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eea79e81-af52-43ca-b1e9-1e6f238bc35d {{(pid=82569) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 19:47:18 devstack cinder-volume[82569]: INFO cinder.image.image_utils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Converted 1024.00 MB image at 399.97 MB/s Apr 16 19:47:18 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eea79e81-af52-43ca-b1e9-1e6f238bc35d is being set with open permissions: ugo+rw Apr 16 19:47:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eea79e81-af52-43ca-b1e9-1e6f238bc35d {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:18 devstack sudo[88631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eea79e81-af52-43ca-b1e9-1e6f238bc35d Apr 16 19:47:18 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:19 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eea79e81-af52-43ca-b1e9-1e6f238bc35d" returned: 0 in 0.486s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:19 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-quobyte-eea79e81-af52-43ca-b1e9-1e6f238bc35d" released by "_copy_volume_from_snapshot" :: held 4.914s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:19 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "cinder-quobyte-08f6b4c2-9f06-4727-a70c-c5af2c260a82" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:19 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-quobyte-08f6b4c2-9f06-4727-a70c-c5af2c260a82" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:19 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Deleting offline snapshot 08f6b4c2-9f06-4727-a70c-c5af2c260a82 of volume 3959e018-da5d-4e2e-acb7-10bf89d9d8ed {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:47:19 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] snapshot_file for this snap is: volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.08f6b4c2-9f06-4727-a70c-c5af2c260a82 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:47:19 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c57223-832a-4740-9515-3b2963797797]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.08f6b4c2-9f06-4727-a70c-c5af2c260a82 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:19 devstack sudo[88634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.08f6b4c2-9f06-4727-a70c-c5af2c260a82 Apr 16 19:47:19 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:19 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.08f6b4c2-9f06-4727-a70c-c5af2c260a82" returned: 0 in 0.534s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:19 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:47:19 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[750c06a5-3e49-42a2-8bce-efcd64e9368d]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:19 devstack sudo[88639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed Apr 16 19:47:19 devstack sudo[88639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:20 devstack sudo[88639]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed" returned: 0 in 0.529s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.08f6b4c2-9f06-4727-a70c-c5af2c260a82 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:20 devstack sudo[88644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.08f6b4c2-9f06-4727-a70c-c5af2c260a82 Apr 16 19:47:20 devstack sudo[88644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:20 devstack sudo[88644]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.08f6b4c2-9f06-4727-a70c-c5af2c260a82" returned: 0 in 0.531s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.08f6b4c2-9f06-4727-a70c-c5af2c260a82 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:20 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.08f6b4c2-9f06-4727-a70c-c5af2c260a82 Apr 16 19:47:20 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:21 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed.08f6b4c2-9f06-4727-a70c-c5af2c260a82" returned: 0 in 0.459s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:21 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-quobyte-08f6b4c2-9f06-4727-a70c-c5af2c260a82" released by "_delete_snapshot" :: held 2.113s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.776s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.715s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:21 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-122256257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74449aeb-27f9-4d11-b02b-58006bf32ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f14c8329ec1d4d11a6d9a8246fa0929e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:13Z,use_quota=True,user_id='ee4959e482b04752bf4849114192d498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:47:21 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Creating volume 74449aeb-27f9-4d11-b02b-58006bf32ee6 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:47:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:21 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:47:21 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:47:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:21 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:47:21 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:47:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-74449aeb-27f9-4d11-b02b-58006bf32ee6 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e609199-244a-4ee2-a79e-94806cacf430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eea79e81-af52-43ca-b1e9-1e6f238bc35d', 'volume_size': 1, 'source_volid': '3959e018-da5d-4e2e-acb7-10bf89d9d8ed', 'source_volstatus': 'available'}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:21 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-74449aeb-27f9-4d11-b02b-58006bf32ee6 1073741824 Apr 16 19:47:21 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e434766-5e0b-4dee-94e3-6e9196ef3cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:21 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Volume volume-eea79e81-af52-43ca-b1e9-1e6f238bc35d (eea79e81-af52-43ca-b1e9-1e6f238bc35d): created successfully Apr 16 19:47:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e434766-5e0b-4dee-94e3-6e9196ef3cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Flow 'volume_create_manager' (d9aa5623-b488-4295-a670-7c3b13a9014a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:47:21 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-609f50ef-6078-424e-96ec-360899aba700 tempest-VolumeDependencyTests-1883253271 None] Created volume successfully. Apr 16 19:47:21 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-74449aeb-27f9-4d11-b02b-58006bf32ee6 1073741824" returned: 0 in 0.646s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-74449aeb-27f9-4d11-b02b-58006bf32ee6 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:21 devstack sudo[88657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-74449aeb-27f9-4d11-b02b-58006bf32ee6 Apr 16 19:47:21 devstack sudo[88657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-f115632f-c81d-4d67-bc80-6054745a5d4b tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "cinder-3959e018-da5d-4e2e-acb7-10bf89d9d8ed-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-f115632f-c81d-4d67-bc80-6054745a5d4b tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-3959e018-da5d-4e2e-acb7-10bf89d9d8ed-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-f115632f-c81d-4d67-bc80-6054745a5d4b tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "cinder-quobyte-3959e018-da5d-4e2e-acb7-10bf89d9d8ed" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-f115632f-c81d-4d67-bc80-6054745a5d4b tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-quobyte-3959e018-da5d-4e2e-acb7-10bf89d9d8ed" acquired by "delete_volume" :: waited 0.013s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[f453ceff-f3b2-4b6b-96b9-cb9f22579c15]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f115632f-c81d-4d67-bc80-6054745a5d4b tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:22 devstack sudo[88659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed Apr 16 19:47:22 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Flow 'volume_create_manager' (3730b64b-c91c-486d-9161-745d9cf21d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be6fc393-94f1-443d-ad5c-c85f1c62deac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be6fc393-94f1-443d-ad5c-c85f1c62deac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-924701591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f151e62f-f6cf-407d-b021-226f84142893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cbd8adf59e47a5bc64ac6834709b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:22Z,use_quota=True,user_id='be8a9c954a0a4ab7871aa8a9dc5d3269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64ab0998-d6b9-4007-b1f1-bca2148dd767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64ab0998-d6b9-4007-b1f1-bca2148dd767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99998f7-6d34-4f7c-9e2c-d9ce1571a678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99998f7-6d34-4f7c-9e2c-d9ce1571a678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f151e62f-f6cf-407d-b021-226f84142893', 'volume_name': 'volume-f151e62f-f6cf-407d-b021-226f84142893', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6457c65-4ad1-485f-838e-bc64f691dda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6457c65-4ad1-485f-838e-bc64f691dda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1787717-1551-4b48-aa9d-635fecec7400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:22 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Volume f151e62f-f6cf-407d-b021-226f84142893: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f151e62f-f6cf-407d-b021-226f84142893', 'volume_size': 1} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:22 devstack sudo[88657]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-74449aeb-27f9-4d11-b02b-58006bf32ee6" returned: 0 in 0.503s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-924701591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f151e62f-f6cf-407d-b021-226f84142893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cbd8adf59e47a5bc64ac6834709b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:22Z,use_quota=True,user_id='be8a9c954a0a4ab7871aa8a9dc5d3269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Creating volume f151e62f-f6cf-407d-b021-226f84142893 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:47:22 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d49afac-da95-4dd0-ac22-c22511ff258d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74449aeb-27f9-4d11-b02b-58006bf32ee6', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:22 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893 1073741824 Apr 16 19:47:22 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e147d6a1-4070-4590-92b0-0a69fc96af8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:22 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Volume volume-74449aeb-27f9-4d11-b02b-58006bf32ee6 (74449aeb-27f9-4d11-b02b-58006bf32ee6): created successfully Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e147d6a1-4070-4590-92b0-0a69fc96af8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Flow 'volume_create_manager' (364f3489-4d52-4a25-9ef8-8b85d436b537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:47:22 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-d52eb4f2-7e50-45e3-82e1-a2450673d869 tempest-AbsoluteLimitsTests-64190268 None] Created volume successfully. Apr 16 19:47:22 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f115632f-c81d-4d67-bc80-6054745a5d4b tempest-VolumeDependencyTests-1883253271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed" returned: 0 in 0.542s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f115632f-c81d-4d67-bc80-6054745a5d4b tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:22 devstack sudo[88667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed Apr 16 19:47:22 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:22 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893 1073741824" returned: 0 in 0.493s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:23 devstack sudo[88672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893 Apr 16 19:47:23 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:23 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f115632f-c81d-4d67-bc80-6054745a5d4b tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3959e018-da5d-4e2e-acb7-10bf89d9d8ed" returned: 0 in 0.462s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:23 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-f115632f-c81d-4d67-bc80-6054745a5d4b tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-quobyte-3959e018-da5d-4e2e-acb7-10bf89d9d8ed" released by "delete_volume" :: held 1.043s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:23 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a3fb3076-7b49-46d2-a382-5fcbd8559138 tempest-AbsoluteLimitsTests-64190268 None] Acquiring lock "cinder-74449aeb-27f9-4d11-b02b-58006bf32ee6-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:23 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a3fb3076-7b49-46d2-a382-5fcbd8559138 tempest-AbsoluteLimitsTests-64190268 None] Lock "cinder-74449aeb-27f9-4d11-b02b-58006bf32ee6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:23 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-f115632f-c81d-4d67-bc80-6054745a5d4b tempest-VolumeDependencyTests-1883253271 None] Created reservations ['f55bf147-facd-46eb-a3b1-1e138a98ddb0', '79956163-7ad3-4977-b0c5-e65a96eba744', 'f7764caf-785e-4c26-a17b-caff2fff6716', '18ccab18-931b-48f8-8d86-deef0681b4e2'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:47:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f115632f-c81d-4d67-bc80-6054745a5d4b tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f115632f-c81d-4d67-bc80-6054745a5d4b tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f115632f-c81d-4d67-bc80-6054745a5d4b tempest-VolumeDependencyTests-1883253271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:47:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f115632f-c81d-4d67-bc80-6054745a5d4b tempest-VolumeDependencyTests-1883253271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:47:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f115632f-c81d-4d67-bc80-6054745a5d4b tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f115632f-c81d-4d67-bc80-6054745a5d4b tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:23 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a3fb3076-7b49-46d2-a382-5fcbd8559138 tempest-AbsoluteLimitsTests-64190268 None] Acquiring lock "cinder-quobyte-74449aeb-27f9-4d11-b02b-58006bf32ee6" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:23 devstack sudo[88675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:47:23 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:23 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a3fb3076-7b49-46d2-a382-5fcbd8559138 tempest-AbsoluteLimitsTests-64190268 None] Lock "cinder-quobyte-74449aeb-27f9-4d11-b02b-58006bf32ee6" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:23 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d64a32-f97b-4394-bf07-82a8113723ad]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a3fb3076-7b49-46d2-a382-5fcbd8559138 tempest-AbsoluteLimitsTests-64190268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-74449aeb-27f9-4d11-b02b-58006bf32ee6 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:23 devstack sudo[88677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-74449aeb-27f9-4d11-b02b-58006bf32ee6 Apr 16 19:47:23 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:23 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893" returned: 0 in 0.500s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:47:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1787717-1551-4b48-aa9d-635fecec7400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f151e62f-f6cf-407d-b021-226f84142893', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91a7b7cc-7bc7-448d-b251-c41ea717f096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:23 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Volume volume-f151e62f-f6cf-407d-b021-226f84142893 (f151e62f-f6cf-407d-b021-226f84142893): created successfully Apr 16 19:47:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91a7b7cc-7bc7-448d-b251-c41ea717f096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:23 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Flow 'volume_create_manager' (3730b64b-c91c-486d-9161-745d9cf21d48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:47:23 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-713e5723-dd43-47c5-b6f0-09f81b4a0cf6 tempest-VolumesSnapshotTestJSON-1777891004 None] Created volume successfully. Apr 16 19:47:23 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f115632f-c81d-4d67-bc80-6054745a5d4b tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.421s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:23 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-f115632f-c81d-4d67-bc80-6054745a5d4b tempest-VolumeDependencyTests-1883253271 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:47:23 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-f115632f-c81d-4d67-bc80-6054745a5d4b tempest-VolumeDependencyTests-1883253271 None] Deleted volume successfully. Apr 16 19:47:23 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-f115632f-c81d-4d67-bc80-6054745a5d4b tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-3959e018-da5d-4e2e-acb7-10bf89d9d8ed-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:23 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a3fb3076-7b49-46d2-a382-5fcbd8559138 tempest-AbsoluteLimitsTests-64190268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-74449aeb-27f9-4d11-b02b-58006bf32ee6" returned: 0 in 0.518s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a3fb3076-7b49-46d2-a382-5fcbd8559138 tempest-AbsoluteLimitsTests-64190268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-74449aeb-27f9-4d11-b02b-58006bf32ee6 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:23 devstack sudo[88685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-74449aeb-27f9-4d11-b02b-58006bf32ee6 Apr 16 19:47:23 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:24 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a3fb3076-7b49-46d2-a382-5fcbd8559138 tempest-AbsoluteLimitsTests-64190268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-74449aeb-27f9-4d11-b02b-58006bf32ee6" returned: 0 in 0.412s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:24 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a3fb3076-7b49-46d2-a382-5fcbd8559138 tempest-AbsoluteLimitsTests-64190268 None] Lock "cinder-quobyte-74449aeb-27f9-4d11-b02b-58006bf32ee6" released by "delete_volume" :: held 0.960s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:24 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-40ebae37-f505-4c4d-8a74-5ee96b479ba6 tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "cinder-eea79e81-af52-43ca-b1e9-1e6f238bc35d-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:24 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-40ebae37-f505-4c4d-8a74-5ee96b479ba6 tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-eea79e81-af52-43ca-b1e9-1e6f238bc35d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:24 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-40ebae37-f505-4c4d-8a74-5ee96b479ba6 tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "cinder-quobyte-eea79e81-af52-43ca-b1e9-1e6f238bc35d" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:24 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-a3fb3076-7b49-46d2-a382-5fcbd8559138 tempest-AbsoluteLimitsTests-64190268 None] Created reservations ['f824dd5a-9f99-42c0-aa35-448e172fa475', '2022a1fd-aece-4cf6-bf40-861418defee5', '0cfdf7f1-265f-46ea-bfde-94c6d09d09c4', 'e12443ac-8806-49c4-b23d-ae7e0233e8f6'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:47:24 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-40ebae37-f505-4c4d-8a74-5ee96b479ba6 tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-quobyte-eea79e81-af52-43ca-b1e9-1e6f238bc35d" acquired by "delete_volume" :: waited 0.014s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:24 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f4fb3e-b089-4192-9255-df2b8fdce5d6]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40ebae37-f505-4c4d-8a74-5ee96b479ba6 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eea79e81-af52-43ca-b1e9-1e6f238bc35d {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a3fb3076-7b49-46d2-a382-5fcbd8559138 tempest-AbsoluteLimitsTests-64190268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a3fb3076-7b49-46d2-a382-5fcbd8559138 tempest-AbsoluteLimitsTests-64190268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:24 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-a3fb3076-7b49-46d2-a382-5fcbd8559138 tempest-AbsoluteLimitsTests-64190268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:47:24 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-a3fb3076-7b49-46d2-a382-5fcbd8559138 tempest-AbsoluteLimitsTests-64190268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:47:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a3fb3076-7b49-46d2-a382-5fcbd8559138 tempest-AbsoluteLimitsTests-64190268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a3fb3076-7b49-46d2-a382-5fcbd8559138 tempest-AbsoluteLimitsTests-64190268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:24 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:47:24 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:24 devstack sudo[88688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eea79e81-af52-43ca-b1e9-1e6f238bc35d Apr 16 19:47:24 devstack sudo[88688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-8a9026ae-1465-4ca2-9ebb-fa45c698bb52 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-8a9026ae-1465-4ca2-9ebb-fa45c698bb52 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:24 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-8a9026ae-1465-4ca2-9ebb-fa45c698bb52 tempest-VolumesSnapshotTestJSON-1777891004 None] Creating offline snapshot aaafcc3f-0b62-4fb2-9bcb-4f6564141d82 of volume f151e62f-f6cf-407d-b021-226f84142893 {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:47:24 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[463398c2-3ab2-4e5e-ad4b-fec9ac1f8269]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8a9026ae-1465-4ca2-9ebb-fa45c698bb52 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:24 devstack sudo[88692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893 Apr 16 19:47:24 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:24 devstack sudo[88688]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40ebae37-f505-4c4d-8a74-5ee96b479ba6 tempest-VolumeDependencyTests-1883253271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eea79e81-af52-43ca-b1e9-1e6f238bc35d" returned: 0 in 0.532s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40ebae37-f505-4c4d-8a74-5ee96b479ba6 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eea79e81-af52-43ca-b1e9-1e6f238bc35d {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:24 devstack sudo[88698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eea79e81-af52-43ca-b1e9-1e6f238bc35d Apr 16 19:47:24 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:24 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a3fb3076-7b49-46d2-a382-5fcbd8559138 tempest-AbsoluteLimitsTests-64190268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.519s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:24 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-a3fb3076-7b49-46d2-a382-5fcbd8559138 tempest-AbsoluteLimitsTests-64190268 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:47:24 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-a3fb3076-7b49-46d2-a382-5fcbd8559138 tempest-AbsoluteLimitsTests-64190268 None] Deleted volume successfully. Apr 16 19:47:25 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a3fb3076-7b49-46d2-a382-5fcbd8559138 tempest-AbsoluteLimitsTests-64190268 None] Lock "cinder-74449aeb-27f9-4d11-b02b-58006bf32ee6-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:25 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8a9026ae-1465-4ca2-9ebb-fa45c698bb52 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893" returned: 0 in 0.485s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8a9026ae-1465-4ca2-9ebb-fa45c698bb52 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893.aaafcc3f-0b62-4fb2-9bcb-4f6564141d82 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:25 devstack sudo[88703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893.aaafcc3f-0b62-4fb2-9bcb-4f6564141d82 1G Apr 16 19:47:25 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:25 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40ebae37-f505-4c4d-8a74-5ee96b479ba6 tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eea79e81-af52-43ca-b1e9-1e6f238bc35d" returned: 0 in 0.415s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:25 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-40ebae37-f505-4c4d-8a74-5ee96b479ba6 tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-quobyte-eea79e81-af52-43ca-b1e9-1e6f238bc35d" released by "delete_volume" :: held 0.979s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:25 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-40ebae37-f505-4c4d-8a74-5ee96b479ba6 tempest-VolumeDependencyTests-1883253271 None] Created reservations ['46643f12-a53c-41e5-a26d-4c08751586f5', '290cdc5a-07cd-4c8c-920e-6684e84f42bf', 'ba98b841-7e83-43af-8c34-b034072876a5', 'e38c2562-f738-491a-bffc-121c604b4dcf'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:47:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-40ebae37-f505-4c4d-8a74-5ee96b479ba6 tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-40ebae37-f505-4c4d-8a74-5ee96b479ba6 tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:25 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-40ebae37-f505-4c4d-8a74-5ee96b479ba6 tempest-VolumeDependencyTests-1883253271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:47:25 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-40ebae37-f505-4c4d-8a74-5ee96b479ba6 tempest-VolumeDependencyTests-1883253271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:47:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-40ebae37-f505-4c4d-8a74-5ee96b479ba6 tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40ebae37-f505-4c4d-8a74-5ee96b479ba6 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:25 devstack sudo[88706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:47:25 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:25 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bf12e50a-23e8-4d4c-95c6-062b964419e7 tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "cinder-eb096954-eaa1-478c-897b-e7aa8d9388a0-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:25 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bf12e50a-23e8-4d4c-95c6-062b964419e7 tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-eb096954-eaa1-478c-897b-e7aa8d9388a0-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:25 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bf12e50a-23e8-4d4c-95c6-062b964419e7 tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "cinder-quobyte-eb096954-eaa1-478c-897b-e7aa8d9388a0" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:25 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bf12e50a-23e8-4d4c-95c6-062b964419e7 tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-quobyte-eb096954-eaa1-478c-897b-e7aa8d9388a0" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:25 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afb753d-9e00-4995-a952-e805b830bc32]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bf12e50a-23e8-4d4c-95c6-062b964419e7 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb096954-eaa1-478c-897b-e7aa8d9388a0 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:25 devstack sudo[88711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb096954-eaa1-478c-897b-e7aa8d9388a0 Apr 16 19:47:25 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:25 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8a9026ae-1465-4ca2-9ebb-fa45c698bb52 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893.aaafcc3f-0b62-4fb2-9bcb-4f6564141d82 1G" returned: 0 in 0.669s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8a9026ae-1465-4ca2-9ebb-fa45c698bb52 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f151e62f-f6cf-407d-b021-226f84142893 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893.aaafcc3f-0b62-4fb2-9bcb-4f6564141d82 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:25 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f151e62f-f6cf-407d-b021-226f84142893 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893.aaafcc3f-0b62-4fb2-9bcb-4f6564141d82 Apr 16 19:47:25 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:26 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40ebae37-f505-4c4d-8a74-5ee96b479ba6 tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.540s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:26 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-40ebae37-f505-4c4d-8a74-5ee96b479ba6 tempest-VolumeDependencyTests-1883253271 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:47:26 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-40ebae37-f505-4c4d-8a74-5ee96b479ba6 tempest-VolumeDependencyTests-1883253271 None] Deleted volume successfully. Apr 16 19:47:26 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-40ebae37-f505-4c4d-8a74-5ee96b479ba6 tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-eea79e81-af52-43ca-b1e9-1e6f238bc35d-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:26 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bf12e50a-23e8-4d4c-95c6-062b964419e7 tempest-VolumeDependencyTests-1883253271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb096954-eaa1-478c-897b-e7aa8d9388a0" returned: 0 in 0.598s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bf12e50a-23e8-4d4c-95c6-062b964419e7 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb096954-eaa1-478c-897b-e7aa8d9388a0 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:26 devstack sudo[88722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb096954-eaa1-478c-897b-e7aa8d9388a0 Apr 16 19:47:26 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:26 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8a9026ae-1465-4ca2-9ebb-fa45c698bb52 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f151e62f-f6cf-407d-b021-226f84142893 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893.aaafcc3f-0b62-4fb2-9bcb-4f6564141d82" returned: 0 in 0.551s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:26 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-8a9026ae-1465-4ca2-9ebb-fa45c698bb52 tempest-VolumesSnapshotTestJSON-1777891004 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893.aaafcc3f-0b62-4fb2-9bcb-4f6564141d82 is being set with open permissions: ugo+rw Apr 16 19:47:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8a9026ae-1465-4ca2-9ebb-fa45c698bb52 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893.aaafcc3f-0b62-4fb2-9bcb-4f6564141d82 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:26 devstack sudo[88724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893.aaafcc3f-0b62-4fb2-9bcb-4f6564141d82 Apr 16 19:47:26 devstack sudo[88724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:26 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bf12e50a-23e8-4d4c-95c6-062b964419e7 tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-eb096954-eaa1-478c-897b-e7aa8d9388a0" returned: 0 in 0.528s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:26 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bf12e50a-23e8-4d4c-95c6-062b964419e7 tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-quobyte-eb096954-eaa1-478c-897b-e7aa8d9388a0" released by "delete_volume" :: held 1.170s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:26 devstack sudo[88724]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:26 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-bf12e50a-23e8-4d4c-95c6-062b964419e7 tempest-VolumeDependencyTests-1883253271 None] Created reservations ['6186b6d2-87e4-4ae4-9522-36e8739de03b', '72440312-c1d7-477a-84d8-c079ae44e5b3', '74c67074-d657-4388-b0ec-03572e36ffbb', 'f8060ce6-d59b-4bdb-9697-c60cd28b260b'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:47:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8a9026ae-1465-4ca2-9ebb-fa45c698bb52 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893.aaafcc3f-0b62-4fb2-9bcb-4f6564141d82" returned: 0 in 0.554s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8a9026ae-1465-4ca2-9ebb-fa45c698bb52 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bf12e50a-23e8-4d4c-95c6-062b964419e7 tempest-VolumeDependencyTests-1883253271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bf12e50a-23e8-4d4c-95c6-062b964419e7 tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:27 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bf12e50a-23e8-4d4c-95c6-062b964419e7 tempest-VolumeDependencyTests-1883253271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:47:27 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bf12e50a-23e8-4d4c-95c6-062b964419e7 tempest-VolumeDependencyTests-1883253271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:47:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bf12e50a-23e8-4d4c-95c6-062b964419e7 tempest-VolumeDependencyTests-1883253271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bf12e50a-23e8-4d4c-95c6-062b964419e7 tempest-VolumeDependencyTests-1883253271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:27 devstack sudo[88728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893.info Apr 16 19:47:27 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:27 devstack sudo[88729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:47:27 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:27 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8a9026ae-1465-4ca2-9ebb-fa45c698bb52 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893.info" returned: 0 in 0.540s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:27 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-8a9026ae-1465-4ca2-9ebb-fa45c698bb52 tempest-VolumesSnapshotTestJSON-1777891004 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893.info is being set with open permissions: ugo+rw Apr 16 19:47:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8a9026ae-1465-4ca2-9ebb-fa45c698bb52 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:27 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bf12e50a-23e8-4d4c-95c6-062b964419e7 tempest-VolumeDependencyTests-1883253271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.542s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:27 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-bf12e50a-23e8-4d4c-95c6-062b964419e7 tempest-VolumeDependencyTests-1883253271 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:47:27 devstack sudo[88734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893.info Apr 16 19:47:27 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:27 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-bf12e50a-23e8-4d4c-95c6-062b964419e7 tempest-VolumeDependencyTests-1883253271 None] Deleted volume successfully. Apr 16 19:47:27 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bf12e50a-23e8-4d4c-95c6-062b964419e7 tempest-VolumeDependencyTests-1883253271 None] Lock "cinder-eb096954-eaa1-478c-897b-e7aa8d9388a0-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:28 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-8a9026ae-1465-4ca2-9ebb-fa45c698bb52 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893.info" returned: 0 in 0.548s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-8a9026ae-1465-4ca2-9ebb-fa45c698bb52 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.425s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:28 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-8a9026ae-1465-4ca2-9ebb-fa45c698bb52 tempest-VolumesSnapshotTestJSON-1777891004 None] Create snapshot completed successfully Apr 16 19:47:28 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:47:28 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Flow 'volume_create_manager' (31e3e8f5-a045-4e15-924b-b616c114cef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:47:28 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810994cf-a849-4a36-b4dc-2a642af4fb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:28 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810994cf-a849-4a36-b4dc-2a642af4fb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-371717428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7500a72-19a1-4b29-9443-e8a9c2cbd11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58444dfb6fb6446eb90c60eeab65f2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:29Z,use_quota=True,user_id='92d7bd91bae7418989fd267ae1c8a17b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:28 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4320f733-ff92-4a0a-9252-272204261cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:28 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4320f733-ff92-4a0a-9252-272204261cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:28 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6547c9c-0dfa-4ce7-8324-c4be05d73153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:28 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6547c9c-0dfa-4ce7-8324-c4be05d73153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7500a72-19a1-4b29-9443-e8a9c2cbd11f', 'volume_name': 'volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:28 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c915164-deb8-4337-8dc8-6f432ec6bce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:28 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c915164-deb8-4337-8dc8-6f432ec6bce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:28 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d102bead-8bf2-4543-a826-b6450fcea409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:28 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Volume c7500a72-19a1-4b29-9443-e8a9c2cbd11f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f', 'volume_size': 1} Apr 16 19:47:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:28 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-371717428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7500a72-19a1-4b29-9443-e8a9c2cbd11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58444dfb6fb6446eb90c60eeab65f2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:29Z,use_quota=True,user_id='92d7bd91bae7418989fd267ae1c8a17b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:47:28 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Creating volume c7500a72-19a1-4b29-9443-e8a9c2cbd11f {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:47:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:28 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:47:28 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:47:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:28 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:47:28 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:47:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:28 devstack sudo[88737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f 1073741824 Apr 16 19:47:28 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:29 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5fa56c24-fa1e-44c8-9ad1-e115db6fe40c tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "cinder-aaafcc3f-0b62-4fb2-9bcb-4f6564141d82-delete_snapshot" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:29 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5fa56c24-fa1e-44c8-9ad1-e115db6fe40c tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-aaafcc3f-0b62-4fb2-9bcb-4f6564141d82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:29 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5fa56c24-fa1e-44c8-9ad1-e115db6fe40c tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "cinder-quobyte-f151e62f-f6cf-407d-b021-226f84142893" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:29 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5fa56c24-fa1e-44c8-9ad1-e115db6fe40c tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-f151e62f-f6cf-407d-b021-226f84142893" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:29 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5fa56c24-fa1e-44c8-9ad1-e115db6fe40c tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "cinder-quobyte-aaafcc3f-0b62-4fb2-9bcb-4f6564141d82" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:29 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5fa56c24-fa1e-44c8-9ad1-e115db6fe40c tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-aaafcc3f-0b62-4fb2-9bcb-4f6564141d82" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-5fa56c24-fa1e-44c8-9ad1-e115db6fe40c tempest-VolumesSnapshotTestJSON-1777891004 None] Deleting offline snapshot aaafcc3f-0b62-4fb2-9bcb-4f6564141d82 of volume f151e62f-f6cf-407d-b021-226f84142893 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:47:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-5fa56c24-fa1e-44c8-9ad1-e115db6fe40c tempest-VolumesSnapshotTestJSON-1777891004 None] snapshot_file for this snap is: volume-f151e62f-f6cf-407d-b021-226f84142893.aaafcc3f-0b62-4fb2-9bcb-4f6564141d82 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:47:29 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[af092ae0-53be-4dd5-94ee-a77f44f788ba]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5fa56c24-fa1e-44c8-9ad1-e115db6fe40c tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893.aaafcc3f-0b62-4fb2-9bcb-4f6564141d82 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:29 devstack sudo[88739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893.aaafcc3f-0b62-4fb2-9bcb-4f6564141d82 Apr 16 19:47:29 devstack sudo[88739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:29 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f 1073741824" returned: 0 in 0.578s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:29 devstack sudo[88744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f Apr 16 19:47:29 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:29 devstack sudo[88739]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5fa56c24-fa1e-44c8-9ad1-e115db6fe40c tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893.aaafcc3f-0b62-4fb2-9bcb-4f6564141d82" returned: 0 in 0.642s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-5fa56c24-fa1e-44c8-9ad1-e115db6fe40c tempest-VolumesSnapshotTestJSON-1777891004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f151e62f-f6cf-407d-b021-226f84142893(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:47:29 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[835423b8-28c6-4104-a8f5-6a626c95f044]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5fa56c24-fa1e-44c8-9ad1-e115db6fe40c tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:29 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893 Apr 16 19:47:29 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Flow 'volume_create_manager' (ad9349d9-dac4-4df5-b78d-f3231c7bea95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:47:30 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e19c44-bb1d-48d0-b834-dd0c57f9a3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e19c44-bb1d-48d0-b834-dd0c57f9a3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f31cab-9e5e-474c-8f32-732733794bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84dfc5ea51044701881565bd538e69c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:30Z,use_quota=True,user_id='b1b4efba9aef46d99b4a9352f40e7566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161f65bd-c156-4c55-97d1-953a0043e4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161f65bd-c156-4c55-97d1-953a0043e4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b944070e-967a-4a25-a2d1-ef2afb42f2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b944070e-967a-4a25-a2d1-ef2afb42f2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26f31cab-9e5e-474c-8f32-732733794bb9', 'volume_name': 'volume-26f31cab-9e5e-474c-8f32-732733794bb9', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14f5d69-21e4-47e2-b53d-bc6654a9d015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14f5d69-21e4-47e2-b53d-bc6654a9d015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0755163e-6b05-409b-87c9-1364a9046da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:30 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Volume 26f31cab-9e5e-474c-8f32-732733794bb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26f31cab-9e5e-474c-8f32-732733794bb9', 'volume_size': 1} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f" returned: 0 in 0.588s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f31cab-9e5e-474c-8f32-732733794bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84dfc5ea51044701881565bd538e69c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:30Z,use_quota=True,user_id='b1b4efba9aef46d99b4a9352f40e7566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Creating volume 26f31cab-9e5e-474c-8f32-732733794bb9 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:47:30 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-26f31cab-9e5e-474c-8f32-732733794bb9 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d102bead-8bf2-4543-a826-b6450fcea409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b2ef41-721f-4f75-96de-d5c71a8a576c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:30 devstack sudo[88752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-26f31cab-9e5e-474c-8f32-732733794bb9 1073741824 Apr 16 19:47:30 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:30 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Volume volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f (c7500a72-19a1-4b29-9443-e8a9c2cbd11f): created successfully Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b2ef41-721f-4f75-96de-d5c71a8a576c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Flow 'volume_create_manager' (31e3e8f5-a045-4e15-924b-b616c114cef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:47:30 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-310c00f7-6c79-4ec6-b329-77452fa3772e tempest-VolumesDeleteCascade-1985327352 None] Created volume successfully. Apr 16 19:47:30 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5fa56c24-fa1e-44c8-9ad1-e115db6fe40c tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893" returned: 0 in 0.567s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5fa56c24-fa1e-44c8-9ad1-e115db6fe40c tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893.aaafcc3f-0b62-4fb2-9bcb-4f6564141d82 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:30 devstack sudo[88757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893.aaafcc3f-0b62-4fb2-9bcb-4f6564141d82 Apr 16 19:47:30 devstack sudo[88757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:30 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-26f31cab-9e5e-474c-8f32-732733794bb9 1073741824" returned: 0 in 0.584s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-26f31cab-9e5e-474c-8f32-732733794bb9 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:30 devstack sudo[88765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-26f31cab-9e5e-474c-8f32-732733794bb9 Apr 16 19:47:30 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:30 devstack sudo[88757]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5fa56c24-fa1e-44c8-9ad1-e115db6fe40c tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893.aaafcc3f-0b62-4fb2-9bcb-4f6564141d82" returned: 0 in 0.566s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5fa56c24-fa1e-44c8-9ad1-e115db6fe40c tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893.aaafcc3f-0b62-4fb2-9bcb-4f6564141d82 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:30 devstack sudo[88767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893.aaafcc3f-0b62-4fb2-9bcb-4f6564141d82 Apr 16 19:47:30 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9b73fb10-91fc-46c7-9c6b-57b7b214fd45 tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:31 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-26f31cab-9e5e-474c-8f32-732733794bb9" returned: 0 in 0.460s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:31 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:47:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9b73fb10-91fc-46c7-9c6b-57b7b214fd45 tempest-VolumesDeleteCascade-1985327352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.133s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:31 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0755163e-6b05-409b-87c9-1364a9046da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26f31cab-9e5e-474c-8f32-732733794bb9', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:31 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f46b4a5-cd75-4ec8-9ec6-62a241dd3f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:31 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-9b73fb10-91fc-46c7-9c6b-57b7b214fd45 tempest-VolumesDeleteCascade-1985327352 None] Creating offline snapshot 2794701b-e1f7-407b-836d-e6b233781eea of volume c7500a72-19a1-4b29-9443-e8a9c2cbd11f {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:47:31 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Volume volume-26f31cab-9e5e-474c-8f32-732733794bb9 (26f31cab-9e5e-474c-8f32-732733794bb9): created successfully Apr 16 19:47:31 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f46b4a5-cd75-4ec8-9ec6-62a241dd3f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:31 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Flow 'volume_create_manager' (ad9349d9-dac4-4df5-b78d-f3231c7bea95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:47:31 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8d9978-ff9c-4cdf-a097-1ebe7be7d7af]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9b73fb10-91fc-46c7-9c6b-57b7b214fd45 tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:31 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-9dc7fc4b-1d1c-45a6-bcdf-32aa83f256fb tempest-CinderUnicodeTest-645661808 None] Created volume successfully. Apr 16 19:47:31 devstack sudo[88770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f Apr 16 19:47:31 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:31 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5fa56c24-fa1e-44c8-9ad1-e115db6fe40c tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893.aaafcc3f-0b62-4fb2-9bcb-4f6564141d82" returned: 0 in 0.528s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:31 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5fa56c24-fa1e-44c8-9ad1-e115db6fe40c tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-aaafcc3f-0b62-4fb2-9bcb-4f6564141d82" released by "_delete_snapshot" :: held 2.374s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:31 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5fa56c24-fa1e-44c8-9ad1-e115db6fe40c tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-f151e62f-f6cf-407d-b021-226f84142893" released by "delete_snapshot" :: held 2.386s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:31 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-5fa56c24-fa1e-44c8-9ad1-e115db6fe40c tempest-VolumesSnapshotTestJSON-1777891004 None] Created reservations ['faa0e926-b077-4413-a8ce-132da48d4488', '3a676630-a3b7-4f59-9622-26a4b6321b78', 'c73746a6-33b8-4c15-9ad0-6f87cd29104f', 'bc7e8505-dae3-49f3-8c81-1d045d9cba49'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:47:31 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-5fa56c24-fa1e-44c8-9ad1-e115db6fe40c tempest-VolumesSnapshotTestJSON-1777891004 None] Delete snapshot completed successfully. Apr 16 19:47:31 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5fa56c24-fa1e-44c8-9ad1-e115db6fe40c tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-aaafcc3f-0b62-4fb2-9bcb-4f6564141d82-delete_snapshot" released by "delete_snapshot" :: held 2.498s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:31 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9b73fb10-91fc-46c7-9c6b-57b7b214fd45 tempest-VolumesDeleteCascade-1985327352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f" returned: 0 in 0.494s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9b73fb10-91fc-46c7-9c6b-57b7b214fd45 tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:31 devstack sudo[88776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea 1G Apr 16 19:47:31 devstack sudo[88776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:32 devstack sudo[88776]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9b73fb10-91fc-46c7-9c6b-57b7b214fd45 tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea 1G" returned: 0 in 0.536s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9b73fb10-91fc-46c7-9c6b-57b7b214fd45 tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:32 devstack sudo[88781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea Apr 16 19:47:32 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Flow 'volume_create_manager' (68dd8686-b0de-4ca0-8a2e-ebf9710a8b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b17ec79-88aa-44f6-a4ab-f0d6fa233fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b17ec79-88aa-44f6-a4ab-f0d6fa233fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-269727270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36845428-150c-4351-9d11-6913d41a3f9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cbd8adf59e47a5bc64ac6834709b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:32Z,use_quota=True,user_id='be8a9c954a0a4ab7871aa8a9dc5d3269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d8172a-4fc4-492d-8b3b-d24e3a5f7b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d8172a-4fc4-492d-8b3b-d24e3a5f7b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5267bf74-8da5-419c-8133-327810177110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5267bf74-8da5-419c-8133-327810177110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36845428-150c-4351-9d11-6913d41a3f9c', 'volume_name': 'volume-36845428-150c-4351-9d11-6913d41a3f9c', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4797d3be-6a3e-4d8a-9d7b-6327a50c135a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4797d3be-6a3e-4d8a-9d7b-6327a50c135a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (665ad3d2-a2d6-4044-be65-342ca08f3c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:32 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Volume 36845428-150c-4351-9d11-6913d41a3f9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36845428-150c-4351-9d11-6913d41a3f9c', 'volume_size': 1} Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Flow 'volume_create_manager' (85a97f60-0481-4529-8cd3-e2a2193965bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19014f97-feac-41eb-96b7-596772b18ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19014f97-feac-41eb-96b7-596772b18ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:47:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1179054438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84dfc5ea51044701881565bd538e69c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:33Z,use_quota=True,user_id='b1b4efba9aef46d99b4a9352f40e7566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5486aa85-631e-4ddb-bff4-1f64eb3d98ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5486aa85-631e-4ddb-bff4-1f64eb3d98ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf57d40-cacc-434c-8e0c-92ef8fa7d42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf57d40-cacc-434c-8e0c-92ef8fa7d42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22', 'volume_name': 'volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b6afeb-5001-43fc-9816-3a030a683853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b6afeb-5001-43fc-9816-3a030a683853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed67d95-bfda-4b02-a09f-2360034c16a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:32 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Volume b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22', 'volume_size': 1} Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:32 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9b73fb10-91fc-46c7-9c6b-57b7b214fd45 tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea" returned: 0 in 0.530s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:32 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-9b73fb10-91fc-46c7-9c6b-57b7b214fd45 tempest-VolumesDeleteCascade-1985327352 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea is being set with open permissions: ugo+rw Apr 16 19:47:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9b73fb10-91fc-46c7-9c6b-57b7b214fd45 tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:32 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea Apr 16 19:47:32 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:33 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9b73fb10-91fc-46c7-9c6b-57b7b214fd45 tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea" returned: 0 in 0.428s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9b73fb10-91fc-46c7-9c6b-57b7b214fd45 tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:33 devstack sudo[88789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.info Apr 16 19:47:33 devstack sudo[88789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:33 devstack sudo[88789]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9b73fb10-91fc-46c7-9c6b-57b7b214fd45 tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.info" returned: 0 in 0.413s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:33 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-9b73fb10-91fc-46c7-9c6b-57b7b214fd45 tempest-VolumesDeleteCascade-1985327352 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.info is being set with open permissions: ugo+rw Apr 16 19:47:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9b73fb10-91fc-46c7-9c6b-57b7b214fd45 tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:33 devstack sudo[88793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.info Apr 16 19:47:33 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:34 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9b73fb10-91fc-46c7-9c6b-57b7b214fd45 tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.info" returned: 0 in 0.389s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9b73fb10-91fc-46c7-9c6b-57b7b214fd45 tempest-VolumesDeleteCascade-1985327352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.876s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.439s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-269727270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36845428-150c-4351-9d11-6913d41a3f9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cbd8adf59e47a5bc64ac6834709b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:32Z,use_quota=True,user_id='be8a9c954a0a4ab7871aa8a9dc5d3269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:47:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Creating volume 36845428-150c-4351-9d11-6913d41a3f9c {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:47:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:47:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:47:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:47:34 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:47:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:34 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c 1073741824 Apr 16 19:47:34 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:34 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-9b73fb10-91fc-46c7-9c6b-57b7b214fd45 tempest-VolumesDeleteCascade-1985327352 None] Create snapshot completed successfully Apr 16 19:47:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b045e0a0-8409-4aaa-b8ed-576bab14f58f tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:34 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c 1073741824" returned: 0 in 0.589s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:34 devstack sudo[88801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c Apr 16 19:47:34 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:35 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c" returned: 0 in 0.410s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:35 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:47:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.397s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:35 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:47:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1179054438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84dfc5ea51044701881565bd538e69c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:33Z,use_quota=True,user_id='b1b4efba9aef46d99b4a9352f40e7566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:47:35 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Creating volume b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:47:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:35 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:47:35 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:47:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:35 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:47:35 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:47:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (665ad3d2-a2d6-4044-be65-342ca08f3c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36845428-150c-4351-9d11-6913d41a3f9c', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e39a412a-7dcf-4996-9d69-51cbd1b20116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:35 devstack sudo[88804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22 1073741824 Apr 16 19:47:35 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:35 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Volume volume-36845428-150c-4351-9d11-6913d41a3f9c (36845428-150c-4351-9d11-6913d41a3f9c): created successfully Apr 16 19:47:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e39a412a-7dcf-4996-9d69-51cbd1b20116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Flow 'volume_create_manager' (68dd8686-b0de-4ca0-8a2e-ebf9710a8b62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:47:35 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-bf388bbe-2a3a-4983-a0b6-65443b817ddc tempest-VolumesSnapshotTestJSON-1777891004 None] Created volume successfully. Apr 16 19:47:35 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22 1073741824" returned: 0 in 0.511s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:35 devstack sudo[88809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22 Apr 16 19:47:35 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bcbdc98c-f593-4e8a-8ce0-b77838babbc8 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:36 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22" returned: 0 in 0.435s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:36 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:47:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b045e0a0-8409-4aaa-b8ed-576bab14f58f tempest-VolumesDeleteCascade-1985327352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.819s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:36 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-b045e0a0-8409-4aaa-b8ed-576bab14f58f tempest-VolumesDeleteCascade-1985327352 None] Creating offline snapshot 142c16b2-b869-4c72-8010-e28bd269b0f5 of volume c7500a72-19a1-4b29-9443-e8a9c2cbd11f {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:47:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed67d95-bfda-4b02-a09f-2360034c16a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4e5608-2edb-41ad-8708-113af47bfe13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:36 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[374a566a-52fb-4d25-b68b-b311de9c670b]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b045e0a0-8409-4aaa-b8ed-576bab14f58f tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:36 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Volume volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22 (b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22): created successfully Apr 16 19:47:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4e5608-2edb-41ad-8708-113af47bfe13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Flow 'volume_create_manager' (85a97f60-0481-4529-8cd3-e2a2193965bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:47:36 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-1a555f06-71d6-473d-8c07-3e4c9b79220f tempest-CinderUnicodeTest-645661808 None] Created volume successfully. Apr 16 19:47:36 devstack sudo[88812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea Apr 16 19:47:36 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:36 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b045e0a0-8409-4aaa-b8ed-576bab14f58f tempest-VolumesDeleteCascade-1985327352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea" returned: 0 in 0.481s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:36 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-b045e0a0-8409-4aaa-b8ed-576bab14f58f tempest-VolumesDeleteCascade-1985327352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:47:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b045e0a0-8409-4aaa-b8ed-576bab14f58f tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.142c16b2-b869-4c72-8010-e28bd269b0f5 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:36 devstack sudo[88817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.142c16b2-b869-4c72-8010-e28bd269b0f5 1G Apr 16 19:47:36 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-818bc547-adec-4f91-ab60-ec6cf998d54b tempest-CinderUnicodeTest-645661808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:37 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b045e0a0-8409-4aaa-b8ed-576bab14f58f tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.142c16b2-b869-4c72-8010-e28bd269b0f5 1G" returned: 0 in 0.536s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b045e0a0-8409-4aaa-b8ed-576bab14f58f tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.142c16b2-b869-4c72-8010-e28bd269b0f5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:37 devstack sudo[88822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.142c16b2-b869-4c72-8010-e28bd269b0f5 Apr 16 19:47:37 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:37 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b045e0a0-8409-4aaa-b8ed-576bab14f58f tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.142c16b2-b869-4c72-8010-e28bd269b0f5" returned: 0 in 0.429s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:37 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-b045e0a0-8409-4aaa-b8ed-576bab14f58f tempest-VolumesDeleteCascade-1985327352 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.142c16b2-b869-4c72-8010-e28bd269b0f5 is being set with open permissions: ugo+rw Apr 16 19:47:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b045e0a0-8409-4aaa-b8ed-576bab14f58f tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.142c16b2-b869-4c72-8010-e28bd269b0f5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:37 devstack sudo[88827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.142c16b2-b869-4c72-8010-e28bd269b0f5 Apr 16 19:47:37 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:37 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b045e0a0-8409-4aaa-b8ed-576bab14f58f tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.142c16b2-b869-4c72-8010-e28bd269b0f5" returned: 0 in 0.425s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b045e0a0-8409-4aaa-b8ed-576bab14f58f tempest-VolumesDeleteCascade-1985327352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.938s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bcbdc98c-f593-4e8a-8ce0-b77838babbc8 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.220s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:38 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-bcbdc98c-f593-4e8a-8ce0-b77838babbc8 tempest-VolumesSnapshotTestJSON-1777891004 None] Creating offline snapshot 99c66bb2-d0ae-4dac-b35b-04b855a0c508 of volume 36845428-150c-4351-9d11-6913d41a3f9c {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:47:38 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-b045e0a0-8409-4aaa-b8ed-576bab14f58f tempest-VolumesDeleteCascade-1985327352 None] Create snapshot completed successfully Apr 16 19:47:38 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[70caf0ac-177a-48bd-af39-771bdb9238b2]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcbdc98c-f593-4e8a-8ce0-b77838babbc8 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:38 devstack sudo[88830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c Apr 16 19:47:38 devstack sudo[88830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:38 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "cinder-c7500a72-19a1-4b29-9443-e8a9c2cbd11f-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:38 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-c7500a72-19a1-4b29-9443-e8a9c2cbd11f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:38 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Performing cascade delete. {{(pid=82569) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 16 19:47:38 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "cinder-142c16b2-b869-4c72-8010-e28bd269b0f5-delete_snapshot" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:38 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-142c16b2-b869-4c72-8010-e28bd269b0f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:38 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "cinder-quobyte-c7500a72-19a1-4b29-9443-e8a9c2cbd11f" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:38 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-quobyte-c7500a72-19a1-4b29-9443-e8a9c2cbd11f" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:38 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "cinder-quobyte-142c16b2-b869-4c72-8010-e28bd269b0f5" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:38 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-quobyte-142c16b2-b869-4c72-8010-e28bd269b0f5" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:38 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Deleting offline snapshot 142c16b2-b869-4c72-8010-e28bd269b0f5 of volume c7500a72-19a1-4b29-9443-e8a9c2cbd11f {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:47:38 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] snapshot_file for this snap is: volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.142c16b2-b869-4c72-8010-e28bd269b0f5 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:47:38 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd5a3b5-c050-4ab7-9cbc-cd240aa86950]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.142c16b2-b869-4c72-8010-e28bd269b0f5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:38 devstack sudo[88830]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcbdc98c-f593-4e8a-8ce0-b77838babbc8 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c" returned: 0 in 0.534s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcbdc98c-f593-4e8a-8ce0-b77838babbc8 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.99c66bb2-d0ae-4dac-b35b-04b855a0c508 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:38 devstack sudo[88836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.99c66bb2-d0ae-4dac-b35b-04b855a0c508 1G Apr 16 19:47:38 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:38 devstack sudo[88835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.142c16b2-b869-4c72-8010-e28bd269b0f5 Apr 16 19:47:38 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:39 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcbdc98c-f593-4e8a-8ce0-b77838babbc8 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.99c66bb2-d0ae-4dac-b35b-04b855a0c508 1G" returned: 0 in 0.507s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcbdc98c-f593-4e8a-8ce0-b77838babbc8 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36845428-150c-4351-9d11-6913d41a3f9c -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.99c66bb2-d0ae-4dac-b35b-04b855a0c508 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:39 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.142c16b2-b869-4c72-8010-e28bd269b0f5" returned: 0 in 0.535s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:47:39 devstack sudo[88845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36845428-150c-4351-9d11-6913d41a3f9c -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.99c66bb2-d0ae-4dac-b35b-04b855a0c508 Apr 16 19:47:39 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:39 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c84914d-5c43-481e-b516-ea151fe4c433]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:39 devstack sudo[88847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea Apr 16 19:47:39 devstack sudo[88847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:39 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcbdc98c-f593-4e8a-8ce0-b77838babbc8 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36845428-150c-4351-9d11-6913d41a3f9c -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.99c66bb2-d0ae-4dac-b35b-04b855a0c508" returned: 0 in 0.482s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:39 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-bcbdc98c-f593-4e8a-8ce0-b77838babbc8 tempest-VolumesSnapshotTestJSON-1777891004 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.99c66bb2-d0ae-4dac-b35b-04b855a0c508 is being set with open permissions: ugo+rw Apr 16 19:47:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcbdc98c-f593-4e8a-8ce0-b77838babbc8 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.99c66bb2-d0ae-4dac-b35b-04b855a0c508 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:39 devstack sudo[88855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.99c66bb2-d0ae-4dac-b35b-04b855a0c508 Apr 16 19:47:39 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:39 devstack sudo[88847]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea" returned: 0 in 0.521s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:47:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.142c16b2-b869-4c72-8010-e28bd269b0f5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:39 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.142c16b2-b869-4c72-8010-e28bd269b0f5 Apr 16 19:47:39 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:40 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcbdc98c-f593-4e8a-8ce0-b77838babbc8 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.99c66bb2-d0ae-4dac-b35b-04b855a0c508" returned: 0 in 0.501s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcbdc98c-f593-4e8a-8ce0-b77838babbc8 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:40 devstack sudo[88863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.info Apr 16 19:47:40 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:40 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.142c16b2-b869-4c72-8010-e28bd269b0f5" returned: 0 in 0.507s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.142c16b2-b869-4c72-8010-e28bd269b0f5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:40 devstack sudo[88865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.142c16b2-b869-4c72-8010-e28bd269b0f5 Apr 16 19:47:40 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:40 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcbdc98c-f593-4e8a-8ce0-b77838babbc8 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.info" returned: 0 in 0.449s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:40 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-bcbdc98c-f593-4e8a-8ce0-b77838babbc8 tempest-VolumesSnapshotTestJSON-1777891004 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.info is being set with open permissions: ugo+rw Apr 16 19:47:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcbdc98c-f593-4e8a-8ce0-b77838babbc8 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:40 devstack sudo[88869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.info Apr 16 19:47:40 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:40 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.142c16b2-b869-4c72-8010-e28bd269b0f5" returned: 0 in 0.438s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:40 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-quobyte-142c16b2-b869-4c72-8010-e28bd269b0f5" released by "_delete_snapshot" :: held 2.065s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:40 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-quobyte-c7500a72-19a1-4b29-9443-e8a9c2cbd11f" released by "delete_snapshot" :: held 2.077s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:40 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Created reservations ['1e801385-0ceb-4477-9ab2-8b8a03dc8afb', '72f89e1f-511b-40a1-a539-033c6ad21154', 'dad4af0d-d458-4f1e-8a9c-3f4c84973ce0', '73567b02-df42-4a58-96d5-1dd9790f995b'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:47:40 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Delete snapshot completed successfully. Apr 16 19:47:40 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-142c16b2-b869-4c72-8010-e28bd269b0f5-delete_snapshot" released by "delete_snapshot" :: held 2.184s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:40 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "cinder-2794701b-e1f7-407b-836d-e6b233781eea-delete_snapshot" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:40 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-2794701b-e1f7-407b-836d-e6b233781eea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:40 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "cinder-quobyte-c7500a72-19a1-4b29-9443-e8a9c2cbd11f" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:40 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-quobyte-c7500a72-19a1-4b29-9443-e8a9c2cbd11f" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:40 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "cinder-quobyte-2794701b-e1f7-407b-836d-e6b233781eea" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:40 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-quobyte-2794701b-e1f7-407b-836d-e6b233781eea" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Deleting offline snapshot 2794701b-e1f7-407b-836d-e6b233781eea of volume c7500a72-19a1-4b29-9443-e8a9c2cbd11f {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:47:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] snapshot_file for this snap is: volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:47:40 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[962c3a0e-fb54-41c6-b81b-8b44bf6c1660]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:40 devstack sudo[88871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea Apr 16 19:47:40 devstack sudo[88871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:41 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcbdc98c-f593-4e8a-8ce0-b77838babbc8 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.info" returned: 0 in 0.472s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bcbdc98c-f593-4e8a-8ce0-b77838babbc8 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.016s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-818bc547-adec-4f91-ab60-ec6cf998d54b tempest-CinderUnicodeTest-645661808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.145s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:41 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-818bc547-adec-4f91-ab60-ec6cf998d54b tempest-CinderUnicodeTest-645661808 None] Creating offline snapshot ca10e74d-5078-4798-b943-6ce7edefcf7f of volume b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22 {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:47:41 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-bcbdc98c-f593-4e8a-8ce0-b77838babbc8 tempest-VolumesSnapshotTestJSON-1777891004 None] Create snapshot completed successfully Apr 16 19:47:41 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebf345a-4b09-46f4-aa69-d39e362131be]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-818bc547-adec-4f91-ab60-ec6cf998d54b tempest-CinderUnicodeTest-645661808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:41 devstack sudo[88874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22 Apr 16 19:47:41 devstack sudo[88874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:41 devstack sudo[88871]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea" returned: 0 in 0.506s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:41 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:47:41 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b38566-2eeb-4d54-8e75-58379ed52963]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:41 devstack sudo[88879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f Apr 16 19:47:41 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:41 devstack sudo[88874]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-818bc547-adec-4f91-ab60-ec6cf998d54b tempest-CinderUnicodeTest-645661808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22" returned: 0 in 0.489s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-818bc547-adec-4f91-ab60-ec6cf998d54b tempest-CinderUnicodeTest-645661808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22.ca10e74d-5078-4798-b943-6ce7edefcf7f 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:41 devstack sudo[88884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22.ca10e74d-5078-4798-b943-6ce7edefcf7f 1G Apr 16 19:47:41 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:41 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f" returned: 0 in 0.511s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:41 devstack sudo[88889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea Apr 16 19:47:41 devstack sudo[88889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:42 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-818bc547-adec-4f91-ab60-ec6cf998d54b tempest-CinderUnicodeTest-645661808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22.ca10e74d-5078-4798-b943-6ce7edefcf7f 1G" returned: 0 in 0.552s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-818bc547-adec-4f91-ab60-ec6cf998d54b tempest-CinderUnicodeTest-645661808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22.ca10e74d-5078-4798-b943-6ce7edefcf7f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:42 devstack sudo[88894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22.ca10e74d-5078-4798-b943-6ce7edefcf7f Apr 16 19:47:42 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:42 devstack sudo[88889]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea" returned: 0 in 0.534s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:42 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea Apr 16 19:47:42 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Flow 'volume_create_manager' (13eed16a-9538-4797-87c8-efd3f310d187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619c2d79-7832-4fda-b177-f413ccb8a168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619c2d79-7832-4fda-b177-f413ccb8a168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1361158830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1180f4b8-9913-4cfd-8273-d83fa7194be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cbd8adf59e47a5bc64ac6834709b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=99c66bb2-d0ae-4dac-b35b-04b855a0c508,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:42Z,use_quota=True,user_id='be8a9c954a0a4ab7871aa8a9dc5d3269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6cdb45e-c1c1-4429-9ac1-3b4443020353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6cdb45e-c1c1-4429-9ac1-3b4443020353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c79a91-a28b-49ce-a4d9-0dc55d43c969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c79a91-a28b-49ce-a4d9-0dc55d43c969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1180f4b8-9913-4cfd-8273-d83fa7194be3', 'volume_name': 'volume-1180f4b8-9913-4cfd-8273-d83fa7194be3', 'volume_size': 2, 'snapshot_id': '99c66bb2-d0ae-4dac-b35b-04b855a0c508'}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55b0c6a-a903-4dcb-80b9-05993f379a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55b0c6a-a903-4dcb-80b9-05993f379a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06743f2f-60c6-4e43-95a6-ec2e87408e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:42 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Volume 1180f4b8-9913-4cfd-8273-d83fa7194be3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1180f4b8-9913-4cfd-8273-d83fa7194be3', 'volume_size': 2, 'snapshot_id': '99c66bb2-d0ae-4dac-b35b-04b855a0c508'} Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:42 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-818bc547-adec-4f91-ab60-ec6cf998d54b tempest-CinderUnicodeTest-645661808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22.ca10e74d-5078-4798-b943-6ce7edefcf7f" returned: 0 in 0.504s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:42 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-818bc547-adec-4f91-ab60-ec6cf998d54b tempest-CinderUnicodeTest-645661808 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22.ca10e74d-5078-4798-b943-6ce7edefcf7f is being set with open permissions: ugo+rw Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-818bc547-adec-4f91-ab60-ec6cf998d54b tempest-CinderUnicodeTest-645661808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22.ca10e74d-5078-4798-b943-6ce7edefcf7f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:42 devstack sudo[88904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22.ca10e74d-5078-4798-b943-6ce7edefcf7f Apr 16 19:47:42 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:42 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f.2794701b-e1f7-407b-836d-e6b233781eea" returned: 0 in 0.451s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-quobyte-2794701b-e1f7-407b-836d-e6b233781eea" released by "_delete_snapshot" :: held 2.048s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-quobyte-c7500a72-19a1-4b29-9443-e8a9c2cbd11f" released by "delete_snapshot" :: held 2.062s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Created reservations ['79797164-45c4-49ec-be6e-1bccd7d8063c', 'f8753981-06b0-43a0-bb23-31c9d247e5f6', 'ca60f048-abbb-464b-b818-cd1b19665c65', '6455973b-c005-4d61-8ba7-5fcb9e5214ad'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:47:42 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Delete snapshot completed successfully. Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-2794701b-e1f7-407b-836d-e6b233781eea-delete_snapshot" released by "delete_snapshot" :: held 2.201s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Snapshots deleted, issuing volume delete {{(pid=82569) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "cinder-quobyte-c7500a72-19a1-4b29-9443-e8a9c2cbd11f" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-quobyte-c7500a72-19a1-4b29-9443-e8a9c2cbd11f" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[05173fed-abe5-4631-a14b-63d788908ab5]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:42 devstack sudo[88907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f Apr 16 19:47:42 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:43 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-818bc547-adec-4f91-ab60-ec6cf998d54b tempest-CinderUnicodeTest-645661808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22.ca10e74d-5078-4798-b943-6ce7edefcf7f" returned: 0 in 0.451s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-818bc547-adec-4f91-ab60-ec6cf998d54b tempest-CinderUnicodeTest-645661808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:43 devstack sudo[88910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22.info Apr 16 19:47:43 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:43 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f" returned: 0 in 0.520s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:43 devstack sudo[88917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f Apr 16 19:47:43 devstack sudo[88917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:43 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-818bc547-adec-4f91-ab60-ec6cf998d54b tempest-CinderUnicodeTest-645661808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22.info" returned: 0 in 0.436s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:43 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-818bc547-adec-4f91-ab60-ec6cf998d54b tempest-CinderUnicodeTest-645661808 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22.info is being set with open permissions: ugo+rw Apr 16 19:47:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-818bc547-adec-4f91-ab60-ec6cf998d54b tempest-CinderUnicodeTest-645661808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:43 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22.info Apr 16 19:47:43 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:43 devstack sudo[88917]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7500a72-19a1-4b29-9443-e8a9c2cbd11f" returned: 0 in 0.436s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-quobyte-c7500a72-19a1-4b29-9443-e8a9c2cbd11f" released by "delete_volume" :: held 0.991s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:43 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Created reservations ['87261f8d-359f-49b3-a68a-3a3579d90873', 'bc69919d-5825-4639-957f-7a6339c8b7ce', 'ed1189b9-9322-4bd7-9b17-2c078da24b38', 'c3bf6475-2209-40fb-8500-3f0611a1f5e3'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:47:43 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-818bc547-adec-4f91-ab60-ec6cf998d54b tempest-CinderUnicodeTest-645661808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22.info" returned: 0 in 0.429s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-818bc547-adec-4f91-ab60-ec6cf998d54b tempest-CinderUnicodeTest-645661808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.933s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.538s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "cinder-quobyte-99c66bb2-d0ae-4dac-b35b-04b855a0c508-1180f4b8-9913-4cfd-8273-d83fa7194be3" by "_create_volume_from_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-99c66bb2-d0ae-4dac-b35b-04b855a0c508-1180f4b8-9913-4cfd-8273-d83fa7194be3" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:43 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Creating volume 1180f4b8-9913-4cfd-8273-d83fa7194be3 from snapshot 99c66bb2-d0ae-4dac-b35b-04b855a0c508 {{(pid=82569) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 19:47:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:43 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:47:43 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:47:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:43 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:47:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "cinder-quobyte-1180f4b8-9913-4cfd-8273-d83fa7194be3" by "_copy_volume_from_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:43 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-818bc547-adec-4f91-ab60-ec6cf998d54b tempest-CinderUnicodeTest-645661808 None] Create snapshot completed successfully Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-1180f4b8-9913-4cfd-8273-d83fa7194be3" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] snapshot: 99c66bb2-d0ae-4dac-b35b-04b855a0c508, volume: 1180f4b8-9913-4cfd-8273-d83fa7194be3, {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7e2f3f-cb33-43a3-82c4-34263fe6c40f]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.99c66bb2-d0ae-4dac-b35b-04b855a0c508 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:44 devstack sudo[88924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:47:44 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:44 devstack sudo[88923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.99c66bb2-d0ae-4dac-b35b-04b855a0c508 Apr 16 19:47:44 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3a9adba1-ee31-46eb-8da9-9d5693e97f6e tempest-CinderUnicodeTest-645661808 None] Acquiring lock "cinder-ca10e74d-5078-4798-b943-6ce7edefcf7f-delete_snapshot" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3a9adba1-ee31-46eb-8da9-9d5693e97f6e tempest-CinderUnicodeTest-645661808 None] Lock "cinder-ca10e74d-5078-4798-b943-6ce7edefcf7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3a9adba1-ee31-46eb-8da9-9d5693e97f6e tempest-CinderUnicodeTest-645661808 None] Acquiring lock "cinder-quobyte-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3a9adba1-ee31-46eb-8da9-9d5693e97f6e tempest-CinderUnicodeTest-645661808 None] Lock "cinder-quobyte-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3a9adba1-ee31-46eb-8da9-9d5693e97f6e tempest-CinderUnicodeTest-645661808 None] Acquiring lock "cinder-quobyte-ca10e74d-5078-4798-b943-6ce7edefcf7f" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3a9adba1-ee31-46eb-8da9-9d5693e97f6e tempest-CinderUnicodeTest-645661808 None] Lock "cinder-quobyte-ca10e74d-5078-4798-b943-6ce7edefcf7f" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-3a9adba1-ee31-46eb-8da9-9d5693e97f6e tempest-CinderUnicodeTest-645661808 None] Deleting offline snapshot ca10e74d-5078-4798-b943-6ce7edefcf7f of volume b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-3a9adba1-ee31-46eb-8da9-9d5693e97f6e tempest-CinderUnicodeTest-645661808 None] snapshot_file for this snap is: volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22.ca10e74d-5078-4798-b943-6ce7edefcf7f {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[711dd0c6-2b79-4ae1-b68b-7a2bd6068e17]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3a9adba1-ee31-46eb-8da9-9d5693e97f6e tempest-CinderUnicodeTest-645661808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22.ca10e74d-5078-4798-b943-6ce7edefcf7f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:44 devstack sudo[88927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22.ca10e74d-5078-4798-b943-6ce7edefcf7f Apr 16 19:47:44 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:44 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.530s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:47:44 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Deleted volume successfully. Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0a1a61c6-381a-497b-8dcc-da09ebaaeb7e tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-c7500a72-19a1-4b29-9443-e8a9c2cbd11f-delete_volume" released by "delete_volume" :: held 6.187s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:44 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.99c66bb2-d0ae-4dac-b35b-04b855a0c508" returned: 0 in 0.595s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36845428-150c-4351-9d11-6913d41a3f9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Creating direct copy from snapshot {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[6488371c-7200-4269-9403-7b621815e152]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:44 devstack sudo[88933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c Apr 16 19:47:44 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:44 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3a9adba1-ee31-46eb-8da9-9d5693e97f6e tempest-CinderUnicodeTest-645661808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22.ca10e74d-5078-4798-b943-6ce7edefcf7f" returned: 0 in 0.599s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-3a9adba1-ee31-46eb-8da9-9d5693e97f6e tempest-CinderUnicodeTest-645661808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd12e73f-2d7a-4d91-bd23-77c31f7a6a4b]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3a9adba1-ee31-46eb-8da9-9d5693e97f6e tempest-CinderUnicodeTest-645661808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:44 devstack sudo[88938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22 Apr 16 19:47:44 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:45 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c" returned: 0 in 0.603s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:45 devstack cinder-volume[82569]: DEBUG cinder.utils [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Path /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1180f4b8-9913-4cfd-8273-d83fa7194be3 not found in is_blk_device check {{(pid=82569) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 19:47:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1180f4b8-9913-4cfd-8273-d83fa7194be3 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:45 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1180f4b8-9913-4cfd-8273-d83fa7194be3 Apr 16 19:47:45 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:45 devstack cinder-volume[82569]: DEBUG dbcounter [-] [82569] Writing DB stats cinder:SELECT=175,cinder:UPDATE=173,cinder:INSERT=57,cinder:DELETE=14 {{(pid=82569) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:47:45 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:47:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Flow 'volume_create_manager' (7eccfd26-067d-4483-af59-a013a995c397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:47:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82170f2b-b43a-49df-95a6-db2f04781ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82170f2b-b43a-49df-95a6-db2f04781ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-840708635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b7e298e-ed5e-446e-814f-b8c34cf783c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58444dfb6fb6446eb90c60eeab65f2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:45Z,use_quota=True,user_id='92d7bd91bae7418989fd267ae1c8a17b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67feb5f-81fb-47be-936a-21c8ba966665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67feb5f-81fb-47be-936a-21c8ba966665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f72797-e146-43aa-b13d-5c2e83518063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f72797-e146-43aa-b13d-5c2e83518063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b7e298e-ed5e-446e-814f-b8c34cf783c4', 'volume_name': 'volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09bb11b8-ae8f-42e2-8be0-cd2c301902c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09bb11b8-ae8f-42e2-8be0-cd2c301902c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff6aa85-ff9d-4ad7-812e-faa9b60c2e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:45 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Volume 7b7e298e-ed5e-446e-814f-b8c34cf783c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4', 'volume_size': 1} Apr 16 19:47:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:45 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3a9adba1-ee31-46eb-8da9-9d5693e97f6e tempest-CinderUnicodeTest-645661808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22" returned: 0 in 0.605s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3a9adba1-ee31-46eb-8da9-9d5693e97f6e tempest-CinderUnicodeTest-645661808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22.ca10e74d-5078-4798-b943-6ce7edefcf7f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:45 devstack sudo[88948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22.ca10e74d-5078-4798-b943-6ce7edefcf7f Apr 16 19:47:45 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:46 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3a9adba1-ee31-46eb-8da9-9d5693e97f6e tempest-CinderUnicodeTest-645661808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22.ca10e74d-5078-4798-b943-6ce7edefcf7f" returned: 0 in 1.365s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3a9adba1-ee31-46eb-8da9-9d5693e97f6e tempest-CinderUnicodeTest-645661808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22.ca10e74d-5078-4798-b943-6ce7edefcf7f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:46 devstack sudo[88964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22.ca10e74d-5078-4798-b943-6ce7edefcf7f Apr 16 19:47:46 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:47 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1180f4b8-9913-4cfd-8273-d83fa7194be3" returned: 0 in 2.580s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:47 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[900ca5fb-96c9-450f-8369-2963e5d97936]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:47 devstack sudo[88966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c Apr 16 19:47:47 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:47 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3a9adba1-ee31-46eb-8da9-9d5693e97f6e tempest-CinderUnicodeTest-645661808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22.ca10e74d-5078-4798-b943-6ce7edefcf7f" returned: 0 in 1.150s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:47 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3a9adba1-ee31-46eb-8da9-9d5693e97f6e tempest-CinderUnicodeTest-645661808 None] Lock "cinder-quobyte-ca10e74d-5078-4798-b943-6ce7edefcf7f" released by "_delete_snapshot" :: held 3.794s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:47 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3a9adba1-ee31-46eb-8da9-9d5693e97f6e tempest-CinderUnicodeTest-645661808 None] Lock "cinder-quobyte-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22" released by "delete_snapshot" :: held 3.808s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:48 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-3a9adba1-ee31-46eb-8da9-9d5693e97f6e tempest-CinderUnicodeTest-645661808 None] Created reservations ['cdf92191-5a63-49e3-9426-4a66f022a62a', 'cfb3eac6-b477-4bb7-aa98-b0c18fcefebb', '5a45a939-e19d-4ec7-9991-f0c9f669270a', 'e7be9d54-dad0-46d3-8b97-d779092df628'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:47:48 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-3a9adba1-ee31-46eb-8da9-9d5693e97f6e tempest-CinderUnicodeTest-645661808 None] Delete snapshot completed successfully. Apr 16 19:47:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3a9adba1-ee31-46eb-8da9-9d5693e97f6e tempest-CinderUnicodeTest-645661808 None] Lock "cinder-ca10e74d-5078-4798-b943-6ce7edefcf7f-delete_snapshot" released by "delete_snapshot" :: held 3.898s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0129c1b3-11bd-41f6-adcc-2462d598f6c6 tempest-CinderUnicodeTest-645661808 None] Acquiring lock "cinder-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0129c1b3-11bd-41f6-adcc-2462d598f6c6 tempest-CinderUnicodeTest-645661808 None] Lock "cinder-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0129c1b3-11bd-41f6-adcc-2462d598f6c6 tempest-CinderUnicodeTest-645661808 None] Acquiring lock "cinder-quobyte-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0129c1b3-11bd-41f6-adcc-2462d598f6c6 tempest-CinderUnicodeTest-645661808 None] Lock "cinder-quobyte-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22" acquired by "delete_volume" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:48 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a7e552-a12e-4755-a218-706be100291a]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0129c1b3-11bd-41f6-adcc-2462d598f6c6 tempest-CinderUnicodeTest-645661808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:48 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c" returned: 0 in 0.662s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:48 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Image conversion details: src /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c, size 1024.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1180f4b8-9913-4cfd-8273-d83fa7194be3 {{(pid=82569) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 19:47:48 devstack cinder-volume[82569]: INFO cinder.image.image_utils [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Converted 1024.00 MB image at 396.72 MB/s Apr 16 19:47:48 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1180f4b8-9913-4cfd-8273-d83fa7194be3 is being set with open permissions: ugo+rw Apr 16 19:47:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1180f4b8-9913-4cfd-8273-d83fa7194be3 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:48 devstack sudo[88973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1180f4b8-9913-4cfd-8273-d83fa7194be3 Apr 16 19:47:48 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:48 devstack sudo[88972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22 Apr 16 19:47:48 devstack sudo[88972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:48 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1180f4b8-9913-4cfd-8273-d83fa7194be3" returned: 0 in 0.426s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-1180f4b8-9913-4cfd-8273-d83fa7194be3" released by "_copy_volume_from_snapshot" :: held 4.935s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-99c66bb2-d0ae-4dac-b35b-04b855a0c508-1180f4b8-9913-4cfd-8273-d83fa7194be3" released by "_create_volume_from_snapshot" :: held 4.962s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.982s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.595s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-840708635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b7e298e-ed5e-446e-814f-b8c34cf783c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58444dfb6fb6446eb90c60eeab65f2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:45Z,use_quota=True,user_id='92d7bd91bae7418989fd267ae1c8a17b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:47:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Creating volume 7b7e298e-ed5e-446e-814f-b8c34cf783c4 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:47:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:47:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:47:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:47:48 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:47:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:48 devstack sudo[88980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4 1073741824 Apr 16 19:47:48 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:48 devstack sudo[88972]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06743f2f-60c6-4e43-95a6-ec2e87408e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1180f4b8-9913-4cfd-8273-d83fa7194be3', 'volume_size': 2, 'snapshot_id': '99c66bb2-d0ae-4dac-b35b-04b855a0c508'}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b718b67-5760-4238-b236-005197518b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0129c1b3-11bd-41f6-adcc-2462d598f6c6 tempest-CinderUnicodeTest-645661808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22" returned: 0 in 0.537s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0129c1b3-11bd-41f6-adcc-2462d598f6c6 tempest-CinderUnicodeTest-645661808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:49 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Volume volume-1180f4b8-9913-4cfd-8273-d83fa7194be3 (1180f4b8-9913-4cfd-8273-d83fa7194be3): created successfully Apr 16 19:47:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b718b67-5760-4238-b236-005197518b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:49 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22 Apr 16 19:47:49 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Flow 'volume_create_manager' (13eed16a-9538-4797-87c8-efd3f310d187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:47:49 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-e68ae1e8-9c73-4cd1-a2eb-63bebcdb7568 tempest-VolumesSnapshotTestJSON-1777891004 None] Created volume successfully. Apr 16 19:47:49 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0129c1b3-11bd-41f6-adcc-2462d598f6c6 tempest-CinderUnicodeTest-645661808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22" returned: 0 in 0.461s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:49 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0129c1b3-11bd-41f6-adcc-2462d598f6c6 tempest-CinderUnicodeTest-645661808 None] Lock "cinder-quobyte-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22" released by "delete_volume" :: held 1.052s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:49 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4 1073741824" returned: 0 in 0.544s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:49 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-0129c1b3-11bd-41f6-adcc-2462d598f6c6 tempest-CinderUnicodeTest-645661808 None] Created reservations ['59a26c31-da21-4e3b-8704-0fcbe93018fb', '6ef2eb43-e266-4953-b908-0ad4733b4268', '6edb3ce3-db35-4ef4-acb3-72925dd2d2a8', '869759c6-f5cb-403f-983c-e15b4d8eaf3a'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:47:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0129c1b3-11bd-41f6-adcc-2462d598f6c6 tempest-CinderUnicodeTest-645661808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0129c1b3-11bd-41f6-adcc-2462d598f6c6 tempest-CinderUnicodeTest-645661808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:49 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0129c1b3-11bd-41f6-adcc-2462d598f6c6 tempest-CinderUnicodeTest-645661808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:47:49 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0129c1b3-11bd-41f6-adcc-2462d598f6c6 tempest-CinderUnicodeTest-645661808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:47:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0129c1b3-11bd-41f6-adcc-2462d598f6c6 tempest-CinderUnicodeTest-645661808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0129c1b3-11bd-41f6-adcc-2462d598f6c6 tempest-CinderUnicodeTest-645661808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:49 devstack sudo[88988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4 Apr 16 19:47:49 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:49 devstack sudo[88990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:47:49 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:49 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-fbcaf8b8-a53a-4a09-89d1-552e4ee8f261 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "cinder-1180f4b8-9913-4cfd-8273-d83fa7194be3-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:49 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-fbcaf8b8-a53a-4a09-89d1-552e4ee8f261 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-1180f4b8-9913-4cfd-8273-d83fa7194be3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:49 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-fbcaf8b8-a53a-4a09-89d1-552e4ee8f261 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "cinder-quobyte-1180f4b8-9913-4cfd-8273-d83fa7194be3" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:49 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-fbcaf8b8-a53a-4a09-89d1-552e4ee8f261 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-1180f4b8-9913-4cfd-8273-d83fa7194be3" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:49 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d97a2f-f9c9-4ff8-b2bd-f2d212b5e8fb]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-fbcaf8b8-a53a-4a09-89d1-552e4ee8f261 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1180f4b8-9913-4cfd-8273-d83fa7194be3 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:50 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0129c1b3-11bd-41f6-adcc-2462d598f6c6 tempest-CinderUnicodeTest-645661808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.463s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:50 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-0129c1b3-11bd-41f6-adcc-2462d598f6c6 tempest-CinderUnicodeTest-645661808 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:47:50 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-0129c1b3-11bd-41f6-adcc-2462d598f6c6 tempest-CinderUnicodeTest-645661808 None] Deleted volume successfully. Apr 16 19:47:50 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0129c1b3-11bd-41f6-adcc-2462d598f6c6 tempest-CinderUnicodeTest-645661808 None] Lock "cinder-b660dbfe-3fc8-4bf5-83d0-6d0ecea8ca22-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:50 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4" returned: 0 in 0.524s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:47:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:50 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff6aa85-ff9d-4ad7-812e-faa9b60c2e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:50 devstack sudo[88994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1180f4b8-9913-4cfd-8273-d83fa7194be3 Apr 16 19:47:50 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:50 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c03bec-0421-4103-ab9a-cc5c3880491b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:50 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Volume volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4 (7b7e298e-ed5e-446e-814f-b8c34cf783c4): created successfully Apr 16 19:47:50 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c03bec-0421-4103-ab9a-cc5c3880491b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:50 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Flow 'volume_create_manager' (7eccfd26-067d-4483-af59-a013a995c397) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:47:50 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-3101c291-8b60-4c05-9a07-02d63a620312 tempest-VolumesDeleteCascade-1985327352 None] Created volume successfully. Apr 16 19:47:50 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-fbcaf8b8-a53a-4a09-89d1-552e4ee8f261 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1180f4b8-9913-4cfd-8273-d83fa7194be3" returned: 0 in 0.528s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-fbcaf8b8-a53a-4a09-89d1-552e4ee8f261 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1180f4b8-9913-4cfd-8273-d83fa7194be3 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:50 devstack sudo[88999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1180f4b8-9913-4cfd-8273-d83fa7194be3 Apr 16 19:47:50 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:50 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-258b8db0-04a2-4cd6-9665-6169c383c156 tempest-CinderUnicodeTest-645661808 None] Acquiring lock "cinder-26f31cab-9e5e-474c-8f32-732733794bb9-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:50 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-258b8db0-04a2-4cd6-9665-6169c383c156 tempest-CinderUnicodeTest-645661808 None] Lock "cinder-26f31cab-9e5e-474c-8f32-732733794bb9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:50 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-258b8db0-04a2-4cd6-9665-6169c383c156 tempest-CinderUnicodeTest-645661808 None] Acquiring lock "cinder-quobyte-26f31cab-9e5e-474c-8f32-732733794bb9" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:50 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-258b8db0-04a2-4cd6-9665-6169c383c156 tempest-CinderUnicodeTest-645661808 None] Lock "cinder-quobyte-26f31cab-9e5e-474c-8f32-732733794bb9" acquired by "delete_volume" :: waited 0.016s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:50 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf7898f-ffa8-4700-b925-ea87fdaf36f8]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-258b8db0-04a2-4cd6-9665-6169c383c156 tempest-CinderUnicodeTest-645661808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-26f31cab-9e5e-474c-8f32-732733794bb9 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:50 devstack sudo[89001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-26f31cab-9e5e-474c-8f32-732733794bb9 Apr 16 19:47:50 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ee9218ea-1666-47aa-9828-6cbbdd0a6714 tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ee9218ea-1666-47aa-9828-6cbbdd0a6714 tempest-VolumesDeleteCascade-1985327352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-ee9218ea-1666-47aa-9828-6cbbdd0a6714 tempest-VolumesDeleteCascade-1985327352 None] Creating offline snapshot 7e217525-bea3-4fae-874e-d776f91b6ead of volume 7b7e298e-ed5e-446e-814f-b8c34cf783c4 {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:47:50 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae40309d-736c-406d-b9a1-95c013501528]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee9218ea-1666-47aa-9828-6cbbdd0a6714 tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:51 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-fbcaf8b8-a53a-4a09-89d1-552e4ee8f261 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1180f4b8-9913-4cfd-8273-d83fa7194be3" returned: 0 in 0.516s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:51 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-fbcaf8b8-a53a-4a09-89d1-552e4ee8f261 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-1180f4b8-9913-4cfd-8273-d83fa7194be3" released by "delete_volume" :: held 1.068s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:51 devstack sudo[89004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4 Apr 16 19:47:51 devstack sudo[89004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:51 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-fbcaf8b8-a53a-4a09-89d1-552e4ee8f261 tempest-VolumesSnapshotTestJSON-1777891004 None] Created reservations ['90ba27b5-e0b9-4d0f-a61a-868fa75d28d1', 'e2bfb24d-431f-429b-9aab-d06649047b11', '6c915822-2bbd-4a1d-b576-d7037aa6625a', 'c9ccd702-340f-4ea1-af91-bc17e91db849'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:47:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-fbcaf8b8-a53a-4a09-89d1-552e4ee8f261 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-fbcaf8b8-a53a-4a09-89d1-552e4ee8f261 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:51 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-fbcaf8b8-a53a-4a09-89d1-552e4ee8f261 tempest-VolumesSnapshotTestJSON-1777891004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:47:51 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-fbcaf8b8-a53a-4a09-89d1-552e4ee8f261 tempest-VolumesSnapshotTestJSON-1777891004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:47:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-fbcaf8b8-a53a-4a09-89d1-552e4ee8f261 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-fbcaf8b8-a53a-4a09-89d1-552e4ee8f261 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:51 devstack sudo[89006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:47:51 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:51 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-258b8db0-04a2-4cd6-9665-6169c383c156 tempest-CinderUnicodeTest-645661808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-26f31cab-9e5e-474c-8f32-732733794bb9" returned: 0 in 0.624s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-258b8db0-04a2-4cd6-9665-6169c383c156 tempest-CinderUnicodeTest-645661808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-26f31cab-9e5e-474c-8f32-732733794bb9 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:51 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-26f31cab-9e5e-474c-8f32-732733794bb9 Apr 16 19:47:51 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:51 devstack sudo[89004]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee9218ea-1666-47aa-9828-6cbbdd0a6714 tempest-VolumesDeleteCascade-1985327352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4" returned: 0 in 0.549s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee9218ea-1666-47aa-9828-6cbbdd0a6714 tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.7e217525-bea3-4fae-874e-d776f91b6ead 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:51 devstack sudo[89023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.7e217525-bea3-4fae-874e-d776f91b6ead 1G Apr 16 19:47:51 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:51 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-fbcaf8b8-a53a-4a09-89d1-552e4ee8f261 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.468s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:51 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-fbcaf8b8-a53a-4a09-89d1-552e4ee8f261 tempest-VolumesSnapshotTestJSON-1777891004 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:47:51 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-fbcaf8b8-a53a-4a09-89d1-552e4ee8f261 tempest-VolumesSnapshotTestJSON-1777891004 None] Deleted volume successfully. Apr 16 19:47:51 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-fbcaf8b8-a53a-4a09-89d1-552e4ee8f261 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-1180f4b8-9913-4cfd-8273-d83fa7194be3-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:51 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-258b8db0-04a2-4cd6-9665-6169c383c156 tempest-CinderUnicodeTest-645661808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-26f31cab-9e5e-474c-8f32-732733794bb9" returned: 0 in 0.511s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:51 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-258b8db0-04a2-4cd6-9665-6169c383c156 tempest-CinderUnicodeTest-645661808 None] Lock "cinder-quobyte-26f31cab-9e5e-474c-8f32-732733794bb9" released by "delete_volume" :: held 1.158s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:51 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-258b8db0-04a2-4cd6-9665-6169c383c156 tempest-CinderUnicodeTest-645661808 None] Created reservations ['df72a406-5f6e-4de0-b6f4-ad338cf9ce73', '883631f4-c382-4378-a3ef-d5f2f1feb569', '56adace6-5ed7-40bc-99ba-8a056f10be94', 'b90e532b-58f9-4e64-abd1-834aa36586ad'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:47:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-258b8db0-04a2-4cd6-9665-6169c383c156 tempest-CinderUnicodeTest-645661808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-258b8db0-04a2-4cd6-9665-6169c383c156 tempest-CinderUnicodeTest-645661808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:51 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-258b8db0-04a2-4cd6-9665-6169c383c156 tempest-CinderUnicodeTest-645661808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:47:51 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-258b8db0-04a2-4cd6-9665-6169c383c156 tempest-CinderUnicodeTest-645661808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:47:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-258b8db0-04a2-4cd6-9665-6169c383c156 tempest-CinderUnicodeTest-645661808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-258b8db0-04a2-4cd6-9665-6169c383c156 tempest-CinderUnicodeTest-645661808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:51 devstack sudo[89026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:47:51 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:52 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-dae6fdd4-ceef-4b1b-b650-72dfa393d6fe tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "cinder-99c66bb2-d0ae-4dac-b35b-04b855a0c508-delete_snapshot" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:52 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-dae6fdd4-ceef-4b1b-b650-72dfa393d6fe tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-99c66bb2-d0ae-4dac-b35b-04b855a0c508-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:52 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-dae6fdd4-ceef-4b1b-b650-72dfa393d6fe tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "cinder-quobyte-36845428-150c-4351-9d11-6913d41a3f9c" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:52 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee9218ea-1666-47aa-9828-6cbbdd0a6714 tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.7e217525-bea3-4fae-874e-d776f91b6ead 1G" returned: 0 in 0.643s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:52 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-dae6fdd4-ceef-4b1b-b650-72dfa393d6fe tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-36845428-150c-4351-9d11-6913d41a3f9c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:52 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-dae6fdd4-ceef-4b1b-b650-72dfa393d6fe tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "cinder-quobyte-99c66bb2-d0ae-4dac-b35b-04b855a0c508" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee9218ea-1666-47aa-9828-6cbbdd0a6714 tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.7e217525-bea3-4fae-874e-d776f91b6ead {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:52 devstack sudo[89031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.7e217525-bea3-4fae-874e-d776f91b6ead Apr 16 19:47:52 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:52 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-dae6fdd4-ceef-4b1b-b650-72dfa393d6fe tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-99c66bb2-d0ae-4dac-b35b-04b855a0c508" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:52 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-dae6fdd4-ceef-4b1b-b650-72dfa393d6fe tempest-VolumesSnapshotTestJSON-1777891004 None] Deleting offline snapshot 99c66bb2-d0ae-4dac-b35b-04b855a0c508 of volume 36845428-150c-4351-9d11-6913d41a3f9c {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:47:52 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-dae6fdd4-ceef-4b1b-b650-72dfa393d6fe tempest-VolumesSnapshotTestJSON-1777891004 None] snapshot_file for this snap is: volume-36845428-150c-4351-9d11-6913d41a3f9c.99c66bb2-d0ae-4dac-b35b-04b855a0c508 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:47:52 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf94dbf-44c8-408d-9769-57beaf624f34]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-dae6fdd4-ceef-4b1b-b650-72dfa393d6fe tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.99c66bb2-d0ae-4dac-b35b-04b855a0c508 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:52 devstack sudo[89033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.99c66bb2-d0ae-4dac-b35b-04b855a0c508 Apr 16 19:47:52 devstack sudo[89033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:52 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-258b8db0-04a2-4cd6-9665-6169c383c156 tempest-CinderUnicodeTest-645661808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.572s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:52 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-258b8db0-04a2-4cd6-9665-6169c383c156 tempest-CinderUnicodeTest-645661808 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:47:52 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-258b8db0-04a2-4cd6-9665-6169c383c156 tempest-CinderUnicodeTest-645661808 None] Deleted volume successfully. Apr 16 19:47:52 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-258b8db0-04a2-4cd6-9665-6169c383c156 tempest-CinderUnicodeTest-645661808 None] Lock "cinder-26f31cab-9e5e-474c-8f32-732733794bb9-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:52 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee9218ea-1666-47aa-9828-6cbbdd0a6714 tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.7e217525-bea3-4fae-874e-d776f91b6ead" returned: 0 in 0.490s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:52 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-ee9218ea-1666-47aa-9828-6cbbdd0a6714 tempest-VolumesDeleteCascade-1985327352 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.7e217525-bea3-4fae-874e-d776f91b6ead is being set with open permissions: ugo+rw Apr 16 19:47:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee9218ea-1666-47aa-9828-6cbbdd0a6714 tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.7e217525-bea3-4fae-874e-d776f91b6ead {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:52 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.7e217525-bea3-4fae-874e-d776f91b6ead Apr 16 19:47:52 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:52 devstack sudo[89033]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-dae6fdd4-ceef-4b1b-b650-72dfa393d6fe tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.99c66bb2-d0ae-4dac-b35b-04b855a0c508" returned: 0 in 0.618s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:52 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-dae6fdd4-ceef-4b1b-b650-72dfa393d6fe tempest-VolumesSnapshotTestJSON-1777891004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36845428-150c-4351-9d11-6913d41a3f9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:47:52 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb1cc09-a65b-4866-bd5b-c187acb86e0b]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-dae6fdd4-ceef-4b1b-b650-72dfa393d6fe tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:52 devstack sudo[89044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c Apr 16 19:47:52 devstack sudo[89044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:53 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee9218ea-1666-47aa-9828-6cbbdd0a6714 tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.7e217525-bea3-4fae-874e-d776f91b6ead" returned: 0 in 0.540s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee9218ea-1666-47aa-9828-6cbbdd0a6714 tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:53 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.info Apr 16 19:47:53 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:53 devstack sudo[89044]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-dae6fdd4-ceef-4b1b-b650-72dfa393d6fe tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c" returned: 0 in 0.652s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-dae6fdd4-ceef-4b1b-b650-72dfa393d6fe tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.99c66bb2-d0ae-4dac-b35b-04b855a0c508 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:53 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.99c66bb2-d0ae-4dac-b35b-04b855a0c508 Apr 16 19:47:53 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:53 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee9218ea-1666-47aa-9828-6cbbdd0a6714 tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.info" returned: 0 in 0.565s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:53 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-ee9218ea-1666-47aa-9828-6cbbdd0a6714 tempest-VolumesDeleteCascade-1985327352 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.info is being set with open permissions: ugo+rw Apr 16 19:47:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee9218ea-1666-47aa-9828-6cbbdd0a6714 tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:53 devstack sudo[89057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.info Apr 16 19:47:53 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:54 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-dae6fdd4-ceef-4b1b-b650-72dfa393d6fe tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.99c66bb2-d0ae-4dac-b35b-04b855a0c508" returned: 0 in 0.594s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-dae6fdd4-ceef-4b1b-b650-72dfa393d6fe tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.99c66bb2-d0ae-4dac-b35b-04b855a0c508 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:54 devstack sudo[89062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.99c66bb2-d0ae-4dac-b35b-04b855a0c508 Apr 16 19:47:54 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:54 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee9218ea-1666-47aa-9828-6cbbdd0a6714 tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.info" returned: 0 in 0.515s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ee9218ea-1666-47aa-9828-6cbbdd0a6714 tempest-VolumesDeleteCascade-1985327352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.381s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:54 devstack cinder-volume[82569]: DEBUG dbcounter [-] [82569] Writing DB stats cinder:SELECT=148,cinder:DELETE=15,cinder:UPDATE=185,cinder:INSERT=48 {{(pid=82569) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:47:54 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-ee9218ea-1666-47aa-9828-6cbbdd0a6714 tempest-VolumesDeleteCascade-1985327352 None] Create snapshot completed successfully Apr 16 19:47:54 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-dae6fdd4-ceef-4b1b-b650-72dfa393d6fe tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c.99c66bb2-d0ae-4dac-b35b-04b855a0c508" returned: 0 in 0.515s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:54 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-dae6fdd4-ceef-4b1b-b650-72dfa393d6fe tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-99c66bb2-d0ae-4dac-b35b-04b855a0c508" released by "_delete_snapshot" :: held 2.440s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:54 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-dae6fdd4-ceef-4b1b-b650-72dfa393d6fe tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-36845428-150c-4351-9d11-6913d41a3f9c" released by "delete_snapshot" :: held 2.472s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:54 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-dae6fdd4-ceef-4b1b-b650-72dfa393d6fe tempest-VolumesSnapshotTestJSON-1777891004 None] Created reservations ['e021df86-695f-4906-aad8-28fc68310784', 'e7fbfe39-51ae-47c8-8910-42db3d237f45', 'e13beefe-70bd-4024-ad77-a88d9c809092', '342f8c72-25fd-4db6-96c8-99362ec7ac49'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:47:54 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-dae6fdd4-ceef-4b1b-b650-72dfa393d6fe tempest-VolumesSnapshotTestJSON-1777891004 None] Delete snapshot completed successfully. Apr 16 19:47:54 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-dae6fdd4-ceef-4b1b-b650-72dfa393d6fe tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-99c66bb2-d0ae-4dac-b35b-04b855a0c508-delete_snapshot" released by "delete_snapshot" :: held 2.589s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-f1eca6f7-abd7-40c6-b364-f4c16a334b0e tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "cinder-36845428-150c-4351-9d11-6913d41a3f9c-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-f1eca6f7-abd7-40c6-b364-f4c16a334b0e tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-36845428-150c-4351-9d11-6913d41a3f9c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-f1eca6f7-abd7-40c6-b364-f4c16a334b0e tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "cinder-quobyte-36845428-150c-4351-9d11-6913d41a3f9c" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-f1eca6f7-abd7-40c6-b364-f4c16a334b0e tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-36845428-150c-4351-9d11-6913d41a3f9c" acquired by "delete_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadfe5ee-1022-41e6-966f-2057722d3d9a]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f1eca6f7-abd7-40c6-b364-f4c16a334b0e tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Flow 'volume_create_manager' (de8e3fe9-4ca4-4cc1-bf80-edd519e7520d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72206e9-cf3b-4f70-bdb9-18f9f0846f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:55 devstack sudo[89066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c Apr 16 19:47:55 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72206e9-cf3b-4f70-bdb9-18f9f0846f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-952905571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed0f2dff-7e37-4111-a398-8d8573f1683d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58444dfb6fb6446eb90c60eeab65f2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7e217525-bea3-4fae-874e-d776f91b6ead,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:55Z,use_quota=True,user_id='92d7bd91bae7418989fd267ae1c8a17b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76001c5-eb31-4515-8468-610d32c595f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76001c5-eb31-4515-8468-610d32c595f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273cc5f8-7c18-4e99-bc5b-6a44eaf88872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273cc5f8-7c18-4e99-bc5b-6a44eaf88872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ed0f2dff-7e37-4111-a398-8d8573f1683d', 'volume_name': 'volume-ed0f2dff-7e37-4111-a398-8d8573f1683d', 'volume_size': 1, 'snapshot_id': '7e217525-bea3-4fae-874e-d776f91b6ead'}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b4eb922-e5bd-4d5c-9e11-c37433114157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b4eb922-e5bd-4d5c-9e11-c37433114157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b00446-588f-47b1-9aeb-64c76754e96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:55 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Volume ed0f2dff-7e37-4111-a398-8d8573f1683d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ed0f2dff-7e37-4111-a398-8d8573f1683d', 'volume_size': 1, 'snapshot_id': '7e217525-bea3-4fae-874e-d776f91b6ead'} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "cinder-quobyte-7e217525-bea3-4fae-874e-d776f91b6ead-ed0f2dff-7e37-4111-a398-8d8573f1683d" by "_create_volume_from_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-quobyte-7e217525-bea3-4fae-874e-d776f91b6ead-ed0f2dff-7e37-4111-a398-8d8573f1683d" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Creating volume ed0f2dff-7e37-4111-a398-8d8573f1683d from snapshot 7e217525-bea3-4fae-874e-d776f91b6ead {{(pid=82569) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "cinder-quobyte-ed0f2dff-7e37-4111-a398-8d8573f1683d" by "_copy_volume_from_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-quobyte-ed0f2dff-7e37-4111-a398-8d8573f1683d" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] snapshot: 7e217525-bea3-4fae-874e-d776f91b6ead, volume: ed0f2dff-7e37-4111-a398-8d8573f1683d, {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05931b4-38af-47d6-9d39-854a61e57326]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.7e217525-bea3-4fae-874e-d776f91b6ead {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:55 devstack sudo[89068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.7e217525-bea3-4fae-874e-d776f91b6ead Apr 16 19:47:55 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:56 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f1eca6f7-abd7-40c6-b364-f4c16a334b0e tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c" returned: 0 in 0.637s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f1eca6f7-abd7-40c6-b364-f4c16a334b0e tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:56 devstack sudo[89073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c Apr 16 19:47:56 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:56 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.7e217525-bea3-4fae-874e-d776f91b6ead" returned: 0 in 0.608s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:56 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:47:56 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4 {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 19:47:56 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Creating direct copy from snapshot {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 19:47:56 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dc71ce-fcfc-4184-9cf9-486c7d4e3b12]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:56 devstack sudo[89078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4 Apr 16 19:47:56 devstack sudo[89078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:56 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f1eca6f7-abd7-40c6-b364-f4c16a334b0e tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-36845428-150c-4351-9d11-6913d41a3f9c" returned: 0 in 0.507s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:56 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-f1eca6f7-abd7-40c6-b364-f4c16a334b0e tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-36845428-150c-4351-9d11-6913d41a3f9c" released by "delete_volume" :: held 1.193s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:56 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-f1eca6f7-abd7-40c6-b364-f4c16a334b0e tempest-VolumesSnapshotTestJSON-1777891004 None] Created reservations ['57dda55d-dd76-443c-b7ba-12defdb53f19', 'a4c7c579-0c11-40d5-a4b2-9d1a34992d2d', '611be45d-6d23-407c-b89e-e8a64b51755c', '0206a946-998d-402f-af4c-81fe73ff6e4c'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:47:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f1eca6f7-abd7-40c6-b364-f4c16a334b0e tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f1eca6f7-abd7-40c6-b364-f4c16a334b0e tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:47:56 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f1eca6f7-abd7-40c6-b364-f4c16a334b0e tempest-VolumesSnapshotTestJSON-1777891004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:47:56 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f1eca6f7-abd7-40c6-b364-f4c16a334b0e tempest-VolumesSnapshotTestJSON-1777891004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:47:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f1eca6f7-abd7-40c6-b364-f4c16a334b0e tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:47:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f1eca6f7-abd7-40c6-b364-f4c16a334b0e tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:56 devstack sudo[89081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:47:56 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:56 devstack sudo[89078]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4" returned: 0 in 0.555s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:56 devstack cinder-volume[82569]: DEBUG cinder.utils [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Path /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ed0f2dff-7e37-4111-a398-8d8573f1683d not found in is_blk_device check {{(pid=82569) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 19:47:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ed0f2dff-7e37-4111-a398-8d8573f1683d {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:56 devstack sudo[89086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ed0f2dff-7e37-4111-a398-8d8573f1683d Apr 16 19:47:56 devstack sudo[89086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:57 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f1eca6f7-abd7-40c6-b364-f4c16a334b0e tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.476s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:57 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-f1eca6f7-abd7-40c6-b364-f4c16a334b0e tempest-VolumesSnapshotTestJSON-1777891004 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:47:57 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-f1eca6f7-abd7-40c6-b364-f4c16a334b0e tempest-VolumesSnapshotTestJSON-1777891004 None] Deleted volume successfully. Apr 16 19:47:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-f1eca6f7-abd7-40c6-b364-f4c16a334b0e tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-36845428-150c-4351-9d11-6913d41a3f9c-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:47:58 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:47:58 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Flow 'volume_create_manager' (0d90345c-dddb-478c-8a65-655600fa2b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:47:58 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2371ff6c-e8ad-4a14-b5ce-164dfedb585b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:58 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2371ff6c-e8ad-4a14-b5ce-164dfedb585b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1862065380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1a71a5-efa8-4567-b7aa-17ddb8992fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cbd8adf59e47a5bc64ac6834709b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:58Z,use_quota=True,user_id='be8a9c954a0a4ab7871aa8a9dc5d3269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:58 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c6cf1e-bc5b-4759-960e-af154c15be37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:58 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c6cf1e-bc5b-4759-960e-af154c15be37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:58 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904cfb7f-09cc-47d9-bf88-287704462bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:58 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904cfb7f-09cc-47d9-bf88-287704462bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b1a71a5-efa8-4567-b7aa-17ddb8992fd1', 'volume_name': 'volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:58 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6076da9-773d-42a3-abe7-23f47cb54e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:58 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6076da9-773d-42a3-abe7-23f47cb54e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:47:58 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d0a7a17-1279-4ea6-8f21-72af692b4314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:47:58 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Volume 6b1a71a5-efa8-4567-b7aa-17ddb8992fd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1', 'volume_size': 1} Apr 16 19:47:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:47:59 devstack sudo[89086]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ed0f2dff-7e37-4111-a398-8d8573f1683d" returned: 0 in 2.284s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:59 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[999a40b6-f497-4a58-8efa-71c127535d21]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:47:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:59 devstack sudo[89099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4 Apr 16 19:47:59 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:47:59 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root Apr 16 19:47:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4" returned: 0 in 0.792s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:47:59 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Image conversion details: src /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4, size 1024.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ed0f2dff-7e37-4111-a398-8d8573f1683d {{(pid=82569) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 19:47:59 devstack cinder-volume[82569]: INFO cinder.image.image_utils [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Converted 1024.00 MB image at 448.11 MB/s Apr 16 19:47:59 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ed0f2dff-7e37-4111-a398-8d8573f1683d is being set with open permissions: ugo+rw Apr 16 19:47:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ed0f2dff-7e37-4111-a398-8d8573f1683d {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:47:59 devstack sudo[89105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ed0f2dff-7e37-4111-a398-8d8573f1683d Apr 16 19:47:59 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:00 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ed0f2dff-7e37-4111-a398-8d8573f1683d" returned: 0 in 0.446s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:00 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-quobyte-ed0f2dff-7e37-4111-a398-8d8573f1683d" released by "_copy_volume_from_snapshot" :: held 4.745s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:00 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-quobyte-7e217525-bea3-4fae-874e-d776f91b6ead-ed0f2dff-7e37-4111-a398-8d8573f1683d" released by "_create_volume_from_snapshot" :: held 4.763s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.773s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.635s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:00 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1862065380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1a71a5-efa8-4567-b7aa-17ddb8992fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cbd8adf59e47a5bc64ac6834709b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:47:58Z,use_quota=True,user_id='be8a9c954a0a4ab7871aa8a9dc5d3269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:48:00 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Creating volume 6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:48:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:00 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:00 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:00 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:48:00 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:48:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b00446-588f-47b1-9aeb-64c76754e96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed0f2dff-7e37-4111-a398-8d8573f1683d', 'volume_size': 1, 'snapshot_id': '7e217525-bea3-4fae-874e-d776f91b6ead'}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:00 devstack sudo[89108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 1073741824 Apr 16 19:48:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02552b4f-fad7-4a12-92ba-dab96a643299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:00 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:00 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Volume volume-ed0f2dff-7e37-4111-a398-8d8573f1683d (ed0f2dff-7e37-4111-a398-8d8573f1683d): created successfully Apr 16 19:48:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02552b4f-fad7-4a12-92ba-dab96a643299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Flow 'volume_create_manager' (de8e3fe9-4ca4-4cc1-bf80-edd519e7520d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:48:00 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-7fc3c4da-6f15-479a-ab1c-21fa20dc7006 tempest-VolumesDeleteCascade-1985327352 None] Created volume successfully. Apr 16 19:48:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "cinder-7b7e298e-ed5e-446e-814f-b8c34cf783c4-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-7b7e298e-ed5e-446e-814f-b8c34cf783c4-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:01 devstack sudo[89108]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 1073741824" returned: 0 in 0.641s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Performing cascade delete. {{(pid=82569) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 16 19:48:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "cinder-7e217525-bea3-4fae-874e-d776f91b6ead-delete_snapshot" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-7e217525-bea3-4fae-874e-d776f91b6ead-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "cinder-quobyte-7b7e298e-ed5e-446e-814f-b8c34cf783c4" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-quobyte-7b7e298e-ed5e-446e-814f-b8c34cf783c4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "cinder-quobyte-7e217525-bea3-4fae-874e-d776f91b6ead" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-quobyte-7e217525-bea3-4fae-874e-d776f91b6ead" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:01 devstack sudo[89113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 Apr 16 19:48:01 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:01 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Deleting offline snapshot 7e217525-bea3-4fae-874e-d776f91b6ead of volume 7b7e298e-ed5e-446e-814f-b8c34cf783c4 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:48:01 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] snapshot_file for this snap is: volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.7e217525-bea3-4fae-874e-d776f91b6ead {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:48:01 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a903e5-e86e-41f1-917f-2571c2aaa83b]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.7e217525-bea3-4fae-874e-d776f91b6ead {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:01 devstack sudo[89115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.7e217525-bea3-4fae-874e-d776f91b6ead Apr 16 19:48:01 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:01 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1" returned: 0 in 0.551s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:01 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:48:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d0a7a17-1279-4ea6-8f21-72af692b4314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f186215-ed9c-415b-8206-910eebd7955b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:01 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Volume volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 (6b1a71a5-efa8-4567-b7aa-17ddb8992fd1): created successfully Apr 16 19:48:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f186215-ed9c-415b-8206-910eebd7955b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Flow 'volume_create_manager' (0d90345c-dddb-478c-8a65-655600fa2b07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:48:01 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-dac53b85-25c0-4e66-be55-b3d7563ed688 tempest-VolumesSnapshotTestJSON-1777891004 None] Created volume successfully. Apr 16 19:48:01 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.7e217525-bea3-4fae-874e-d776f91b6ead" returned: 0 in 0.571s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:01 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:48:01 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cab7472-71df-4a49-b7ce-7f8f87fca21a]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:01 devstack sudo[89121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4 Apr 16 19:48:01 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:02 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4" returned: 0 in 0.597s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.7e217525-bea3-4fae-874e-d776f91b6ead {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:02 devstack sudo[89126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.7e217525-bea3-4fae-874e-d776f91b6ead Apr 16 19:48:02 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f1118b4c-0a38-4eda-b288-5884171f893f tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f1118b4c-0a38-4eda-b288-5884171f893f tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:02 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-f1118b4c-0a38-4eda-b288-5884171f893f tempest-VolumesSnapshotTestJSON-1777891004 None] Creating offline snapshot e16e07c6-dd2b-4243-9173-340464fd7903 of volume 6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:48:02 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae54db54-9a33-4192-8cc0-ec42ea87f65e]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f1118b4c-0a38-4eda-b288-5884171f893f tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:03 devstack sudo[89130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 Apr 16 19:48:03 devstack sudo[89130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:03 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.7e217525-bea3-4fae-874e-d776f91b6ead" returned: 0 in 0.762s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.7e217525-bea3-4fae-874e-d776f91b6ead {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:03 devstack sudo[89133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.7e217525-bea3-4fae-874e-d776f91b6ead Apr 16 19:48:03 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:03 devstack sudo[89130]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f1118b4c-0a38-4eda-b288-5884171f893f tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1" returned: 0 in 0.653s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f1118b4c-0a38-4eda-b288-5884171f893f tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.e16e07c6-dd2b-4243-9173-340464fd7903 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:03 devstack sudo[89139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.e16e07c6-dd2b-4243-9173-340464fd7903 1G Apr 16 19:48:03 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:03 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4.7e217525-bea3-4fae-874e-d776f91b6ead" returned: 0 in 0.612s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:03 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-quobyte-7e217525-bea3-4fae-874e-d776f91b6ead" released by "_delete_snapshot" :: held 2.594s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:03 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-quobyte-7b7e298e-ed5e-446e-814f-b8c34cf783c4" released by "delete_snapshot" :: held 2.608s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:03 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Created reservations ['a1b9a776-2406-4996-a9bb-c29bf656623e', '0bae256b-b3bc-461c-8f76-30cbf4cbf003', '97a2ce6f-2ae2-4cb1-84c6-fb120590fffe', 'dab88ad9-339c-41ff-a83d-6ad655fa8ff4'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:48:03 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Delete snapshot completed successfully. Apr 16 19:48:03 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-7e217525-bea3-4fae-874e-d776f91b6ead-delete_snapshot" released by "delete_snapshot" :: held 2.726s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:03 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Snapshots deleted, issuing volume delete {{(pid=82569) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 16 19:48:03 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "cinder-quobyte-7b7e298e-ed5e-446e-814f-b8c34cf783c4" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:03 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-quobyte-7b7e298e-ed5e-446e-814f-b8c34cf783c4" acquired by "delete_volume" :: waited 0.007s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:03 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb0c536-4a78-4e4d-aa3c-ff0569663fb5]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:03 devstack sudo[89142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4 Apr 16 19:48:03 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:04 devstack cinder-volume[82569]: DEBUG oslo_service.periodic_task [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82569) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 19:48:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:04 devstack sudo[89147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:48:04 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:04 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f1118b4c-0a38-4eda-b288-5884171f893f tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.e16e07c6-dd2b-4243-9173-340464fd7903 1G" returned: 0 in 0.632s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f1118b4c-0a38-4eda-b288-5884171f893f tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.e16e07c6-dd2b-4243-9173-340464fd7903 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:04 devstack sudo[89149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.e16e07c6-dd2b-4243-9173-340464fd7903 Apr 16 19:48:04 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:04 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4" returned: 0 in 0.621s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:04 devstack sudo[89155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4 Apr 16 19:48:04 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:04 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.494s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:04 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:48:04 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f1118b4c-0a38-4eda-b288-5884171f893f tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.e16e07c6-dd2b-4243-9173-340464fd7903" returned: 0 in 0.564s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:04 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-f1118b4c-0a38-4eda-b288-5884171f893f tempest-VolumesSnapshotTestJSON-1777891004 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.e16e07c6-dd2b-4243-9173-340464fd7903 is being set with open permissions: ugo+rw Apr 16 19:48:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f1118b4c-0a38-4eda-b288-5884171f893f tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.e16e07c6-dd2b-4243-9173-340464fd7903 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:04 devstack sudo[89160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.e16e07c6-dd2b-4243-9173-340464fd7903 Apr 16 19:48:04 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:04 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7b7e298e-ed5e-446e-814f-b8c34cf783c4" returned: 0 in 0.436s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:04 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-quobyte-7b7e298e-ed5e-446e-814f-b8c34cf783c4" released by "delete_volume" :: held 1.100s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:04 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Created reservations ['e5a448fd-8033-4a54-be54-a197103c1cdc', '42588fe1-bced-4c25-bb62-7ffe903d277a', '2f1293ff-17e2-4444-9e1e-87550c73847b', 'b693ff19-fb16-4047-aafa-5eefb0e68cc9'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:48:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:05 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:05 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:05 devstack sudo[89163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:48:05 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:05 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f1118b4c-0a38-4eda-b288-5884171f893f tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.e16e07c6-dd2b-4243-9173-340464fd7903" returned: 0 in 0.492s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f1118b4c-0a38-4eda-b288-5884171f893f tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:05 devstack sudo[89166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.info Apr 16 19:48:05 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:05 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:05 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3e3f62fa-9664-4042-a9d8-4215f6c9159a tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "cinder-ed0f2dff-7e37-4111-a398-8d8573f1683d-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.508s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:05 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:48:05 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3e3f62fa-9664-4042-a9d8-4215f6c9159a tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-ed0f2dff-7e37-4111-a398-8d8573f1683d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:05 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Deleted volume successfully. Apr 16 19:48:05 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3e3f62fa-9664-4042-a9d8-4215f6c9159a tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "cinder-quobyte-ed0f2dff-7e37-4111-a398-8d8573f1683d" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:05 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ad656157-5a54-4de6-9694-ed2baccb2a65 tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-7b7e298e-ed5e-446e-814f-b8c34cf783c4-delete_volume" released by "delete_volume" :: held 4.527s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:05 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3e3f62fa-9664-4042-a9d8-4215f6c9159a tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-quobyte-ed0f2dff-7e37-4111-a398-8d8573f1683d" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:05 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[938e8909-7f6d-45f1-98a1-abe23e2029aa]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3e3f62fa-9664-4042-a9d8-4215f6c9159a tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ed0f2dff-7e37-4111-a398-8d8573f1683d {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:05 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ed0f2dff-7e37-4111-a398-8d8573f1683d Apr 16 19:48:05 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:05 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f1118b4c-0a38-4eda-b288-5884171f893f tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.info" returned: 0 in 0.545s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:05 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-f1118b4c-0a38-4eda-b288-5884171f893f tempest-VolumesSnapshotTestJSON-1777891004 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.info is being set with open permissions: ugo+rw Apr 16 19:48:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f1118b4c-0a38-4eda-b288-5884171f893f tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:05 devstack sudo[89172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.info Apr 16 19:48:05 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:06 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3e3f62fa-9664-4042-a9d8-4215f6c9159a tempest-VolumesDeleteCascade-1985327352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ed0f2dff-7e37-4111-a398-8d8573f1683d" returned: 0 in 0.585s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3e3f62fa-9664-4042-a9d8-4215f6c9159a tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ed0f2dff-7e37-4111-a398-8d8573f1683d {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:06 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ed0f2dff-7e37-4111-a398-8d8573f1683d Apr 16 19:48:06 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:06 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f1118b4c-0a38-4eda-b288-5884171f893f tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.info" returned: 0 in 0.521s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f1118b4c-0a38-4eda-b288-5884171f893f tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.479s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:06 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-f1118b4c-0a38-4eda-b288-5884171f893f tempest-VolumesSnapshotTestJSON-1777891004 None] Create snapshot completed successfully Apr 16 19:48:06 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3e3f62fa-9664-4042-a9d8-4215f6c9159a tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ed0f2dff-7e37-4111-a398-8d8573f1683d" returned: 0 in 0.572s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:06 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3e3f62fa-9664-4042-a9d8-4215f6c9159a tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-quobyte-ed0f2dff-7e37-4111-a398-8d8573f1683d" released by "delete_volume" :: held 1.183s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:06 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-3e3f62fa-9664-4042-a9d8-4215f6c9159a tempest-VolumesDeleteCascade-1985327352 None] Created reservations ['f41b17b6-1f5d-41a3-85b7-57977c73fe51', '49824a06-b242-4184-a145-166e67fc4808', '8722388a-08b1-4944-87ed-c29912a7379b', '09f7b760-33ff-4e48-9912-c124de345f57'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:48:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3e3f62fa-9664-4042-a9d8-4215f6c9159a tempest-VolumesDeleteCascade-1985327352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3e3f62fa-9664-4042-a9d8-4215f6c9159a tempest-VolumesDeleteCascade-1985327352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:06 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3e3f62fa-9664-4042-a9d8-4215f6c9159a tempest-VolumesDeleteCascade-1985327352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:06 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3e3f62fa-9664-4042-a9d8-4215f6c9159a tempest-VolumesDeleteCascade-1985327352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3e3f62fa-9664-4042-a9d8-4215f6c9159a tempest-VolumesDeleteCascade-1985327352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3e3f62fa-9664-4042-a9d8-4215f6c9159a tempest-VolumesDeleteCascade-1985327352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:06 devstack sudo[89181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:48:06 devstack sudo[89181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:07 devstack sudo[89181]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3e3f62fa-9664-4042-a9d8-4215f6c9159a tempest-VolumesDeleteCascade-1985327352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.469s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-3e3f62fa-9664-4042-a9d8-4215f6c9159a tempest-VolumesDeleteCascade-1985327352 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:48:07 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-3e3f62fa-9664-4042-a9d8-4215f6c9159a tempest-VolumesDeleteCascade-1985327352 None] Deleted volume successfully. Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3e3f62fa-9664-4042-a9d8-4215f6c9159a tempest-VolumesDeleteCascade-1985327352 None] Lock "cinder-ed0f2dff-7e37-4111-a398-8d8573f1683d-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Flow 'volume_create_manager' (990985f0-859d-43eb-8e69-95c7e49514b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c01dcb-ce42-48e4-b61c-d863df104d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c01dcb-ce42-48e4-b61c-d863df104d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-921666691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a97c5fdd-e5dc-4b55-9538-b0f785b5dea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cbd8adf59e47a5bc64ac6834709b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e16e07c6-dd2b-4243-9173-340464fd7903,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:07Z,use_quota=True,user_id='be8a9c954a0a4ab7871aa8a9dc5d3269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e50b1214-5917-4517-b5ec-ca1edc609101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e50b1214-5917-4517-b5ec-ca1edc609101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61464c9e-6b59-47bd-9d2c-931d6b3624c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61464c9e-6b59-47bd-9d2c-931d6b3624c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a97c5fdd-e5dc-4b55-9538-b0f785b5dea9', 'volume_name': 'volume-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9', 'volume_size': 1, 'snapshot_id': 'e16e07c6-dd2b-4243-9173-340464fd7903'}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f81d5c8-2c1a-4173-955a-340078d30966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f81d5c8-2c1a-4173-955a-340078d30966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28caa4e7-dfdf-4ef1-82bd-0e333389ddf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:07 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Volume a97c5fdd-e5dc-4b55-9538-b0f785b5dea9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9', 'volume_size': 1, 'snapshot_id': 'e16e07c6-dd2b-4243-9173-340464fd7903'} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "cinder-quobyte-e16e07c6-dd2b-4243-9173-340464fd7903-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9" by "_create_volume_from_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-e16e07c6-dd2b-4243-9173-340464fd7903-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Creating volume a97c5fdd-e5dc-4b55-9538-b0f785b5dea9 from snapshot e16e07c6-dd2b-4243-9173-340464fd7903 {{(pid=82569) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "cinder-quobyte-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9" by "_copy_volume_from_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] snapshot: e16e07c6-dd2b-4243-9173-340464fd7903, volume: a97c5fdd-e5dc-4b55-9538-b0f785b5dea9, {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd57c67-bc59-41ab-8ee2-37509bafacb9]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.e16e07c6-dd2b-4243-9173-340464fd7903 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:07 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.e16e07c6-dd2b-4243-9173-340464fd7903 Apr 16 19:48:07 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:08 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.e16e07c6-dd2b-4243-9173-340464fd7903" returned: 0 in 0.621s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:08 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:48:08 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 19:48:08 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Creating direct copy from snapshot {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 19:48:08 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13f29f7-9051-47b9-8027-074c88696f35]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:08 devstack sudo[89189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 Apr 16 19:48:08 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:08 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1" returned: 0 in 0.679s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:08 devstack cinder-volume[82569]: DEBUG cinder.utils [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Path /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9 not found in is_blk_device check {{(pid=82569) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 19:48:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:08 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9 Apr 16 19:48:08 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:11 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9" returned: 0 in 2.969s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:11 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee020abe-abdb-4319-85f9-cdc9f61eb5e1]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:12 devstack sudo[89240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 Apr 16 19:48:12 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:12 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1" returned: 0 in 0.792s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:12 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Image conversion details: src /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1, size 1024.00 MB, duration 2.97 sec, destination /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9 {{(pid=82569) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 19:48:12 devstack cinder-volume[82569]: INFO cinder.image.image_utils [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Converted 1024.00 MB image at 344.73 MB/s Apr 16 19:48:12 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9 is being set with open permissions: ugo+rw Apr 16 19:48:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:12 devstack sudo[89247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9 Apr 16 19:48:12 devstack sudo[89247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:12 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:48:12 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Flow 'volume_create_manager' (411cf195-255a-4744-8876-bdd05bdb033a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:48:12 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9b2b28-065e-4c94-9f80-d42938f50c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:12 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9b2b28-065e-4c94-9f80-d42938f50c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-56205484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=999264d8-7439-43e9-b4a6-713447591238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a61bb238d13c49cd999ff098aaa978b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:13Z,use_quota=True,user_id='0d323b3dc3e14748bba9cd7215169d37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:12 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a55e96-47b8-4b61-a517-055c77ed5a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:12 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a55e96-47b8-4b61-a517-055c77ed5a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:12 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27b4d9a0-5939-407d-9297-89d1bb4a397d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:12 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27b4d9a0-5939-407d-9297-89d1bb4a397d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '999264d8-7439-43e9-b4a6-713447591238', 'volume_name': 'volume-999264d8-7439-43e9-b4a6-713447591238', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:12 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c318d149-c1cb-40e5-8c97-9e98c44fe1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:12 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c318d149-c1cb-40e5-8c97-9e98c44fe1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:12 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663f3ebf-c600-4831-a731-db53a5b00301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:12 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Volume 999264d8-7439-43e9-b4a6-713447591238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-999264d8-7439-43e9-b4a6-713447591238', 'volume_size': 1} Apr 16 19:48:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:13 devstack sudo[89247]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9" returned: 0 in 0.676s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9" released by "_copy_volume_from_snapshot" :: held 5.811s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-e16e07c6-dd2b-4243-9173-340464fd7903-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9" released by "_create_volume_from_snapshot" :: held 5.830s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.839s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.517s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-56205484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=999264d8-7439-43e9-b4a6-713447591238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a61bb238d13c49cd999ff098aaa978b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:13Z,use_quota=True,user_id='0d323b3dc3e14748bba9cd7215169d37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Creating volume 999264d8-7439-43e9-b4a6-713447591238 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:48:13 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28caa4e7-dfdf-4ef1-82bd-0e333389ddf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9', 'volume_size': 1, 'snapshot_id': 'e16e07c6-dd2b-4243-9173-340464fd7903'}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e323c9-ad9e-46c4-985f-5ccd2185a1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:13 devstack sudo[89251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238 1073741824 Apr 16 19:48:13 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:13 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Volume volume-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9 (a97c5fdd-e5dc-4b55-9538-b0f785b5dea9): created successfully Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e323c9-ad9e-46c4-985f-5ccd2185a1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Flow 'volume_create_manager' (990985f0-859d-43eb-8e69-95c7e49514b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:48:13 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-25eb5865-1cda-402a-a418-b9f808be6452 tempest-VolumesSnapshotTestJSON-1777891004 None] Created volume successfully. Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Flow 'volume_create_manager' (93a0fb82-4c90-4daf-b6ba-08f933744076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a941893a-32c6-49e3-a290-66fdeef6eebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a941893a-32c6-49e3-a290-66fdeef6eebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-661952053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cef60e0-bea6-4aca-abbd-bb999c81d477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d62e3d5019840ee98aed9805eecc00c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:14Z,use_quota=True,user_id='c58c72be6570494d9e33a82a5286db52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6d29088-5d7e-4969-81ca-11ef5fd1bafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6d29088-5d7e-4969-81ca-11ef5fd1bafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e557205-4a69-4da3-b0a6-7e5eb33c1bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e557205-4a69-4da3-b0a6-7e5eb33c1bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cef60e0-bea6-4aca-abbd-bb999c81d477', 'volume_name': 'volume-8cef60e0-bea6-4aca-abbd-bb999c81d477', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83389f64-2120-4a36-9180-235d6c23390e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83389f64-2120-4a36-9180-235d6c23390e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce28b11-946e-44a5-bd9f-72322885648b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:13 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Volume 8cef60e0-bea6-4aca-abbd-bb999c81d477: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cef60e0-bea6-4aca-abbd-bb999c81d477', 'volume_size': 1} Apr 16 19:48:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:14 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-79638cd1-7cbc-4b9a-813c-cea1501d5ee6 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "cinder-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:14 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238 1073741824" returned: 0 in 0.603s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:14 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-79638cd1-7cbc-4b9a-813c-cea1501d5ee6 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:14 devstack sudo[89256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238 Apr 16 19:48:14 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:14 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-79638cd1-7cbc-4b9a-813c-cea1501d5ee6 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "cinder-quobyte-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:14 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-79638cd1-7cbc-4b9a-813c-cea1501d5ee6 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:14 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8169b1-6557-44c7-9005-cf7167da5d43]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-79638cd1-7cbc-4b9a-813c-cea1501d5ee6 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:14 devstack sudo[89258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9 Apr 16 19:48:14 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:14 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238" returned: 0 in 0.424s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:48:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.745s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-661952053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cef60e0-bea6-4aca-abbd-bb999c81d477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d62e3d5019840ee98aed9805eecc00c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:14Z,use_quota=True,user_id='c58c72be6570494d9e33a82a5286db52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:48:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Creating volume 8cef60e0-bea6-4aca-abbd-bb999c81d477 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:48:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:48:14 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:48:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8cef60e0-bea6-4aca-abbd-bb999c81d477 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:14 devstack sudo[89261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8cef60e0-bea6-4aca-abbd-bb999c81d477 1073741824 Apr 16 19:48:14 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663f3ebf-c600-4831-a731-db53a5b00301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-999264d8-7439-43e9-b4a6-713447591238', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afaad6d0-8718-4da9-baf9-d2c15b340988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:14 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Volume volume-999264d8-7439-43e9-b4a6-713447591238 (999264d8-7439-43e9-b4a6-713447591238): created successfully Apr 16 19:48:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afaad6d0-8718-4da9-baf9-d2c15b340988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Flow 'volume_create_manager' (411cf195-255a-4744-8876-bdd05bdb033a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:48:14 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-29ca47d2-c146-45bc-9a13-6cc20c7b9ef1 tempest-SnapshotDependencyTests-1451042187 None] Created volume successfully. Apr 16 19:48:14 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-79638cd1-7cbc-4b9a-813c-cea1501d5ee6 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9" returned: 0 in 0.572s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-79638cd1-7cbc-4b9a-813c-cea1501d5ee6 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:14 devstack sudo[89266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9 Apr 16 19:48:14 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:15 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8cef60e0-bea6-4aca-abbd-bb999c81d477 1073741824" returned: 0 in 0.653s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:15 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-79638cd1-7cbc-4b9a-813c-cea1501d5ee6 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9" returned: 0 in 0.491s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:15 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-79638cd1-7cbc-4b9a-813c-cea1501d5ee6 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9" released by "delete_volume" :: held 1.099s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8cef60e0-bea6-4aca-abbd-bb999c81d477 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f2aed359-9f1b-450f-bc91-9b19e09eb4ab tempest-SnapshotDependencyTests-1451042187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:15 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8cef60e0-bea6-4aca-abbd-bb999c81d477 Apr 16 19:48:15 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:15 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-79638cd1-7cbc-4b9a-813c-cea1501d5ee6 tempest-VolumesSnapshotTestJSON-1777891004 None] Created reservations ['acee2f72-a2c1-4bfa-a3ea-f2aa0484b0a2', '9ec54d5b-38bb-45e4-b4f7-de36c4ec3940', '526c4548-3127-41ba-98c7-289a5eeb43da', 'ffb78574-5a4a-4162-a4b9-ac8db5ca9e62'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:48:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-79638cd1-7cbc-4b9a-813c-cea1501d5ee6 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-79638cd1-7cbc-4b9a-813c-cea1501d5ee6 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:15 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-79638cd1-7cbc-4b9a-813c-cea1501d5ee6 tempest-VolumesSnapshotTestJSON-1777891004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:15 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-79638cd1-7cbc-4b9a-813c-cea1501d5ee6 tempest-VolumesSnapshotTestJSON-1777891004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-79638cd1-7cbc-4b9a-813c-cea1501d5ee6 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-79638cd1-7cbc-4b9a-813c-cea1501d5ee6 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:15 devstack sudo[89274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:48:15 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:15 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8cef60e0-bea6-4aca-abbd-bb999c81d477" returned: 0 in 0.479s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:15 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:48:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f2aed359-9f1b-450f-bc91-9b19e09eb4ab tempest-SnapshotDependencyTests-1451042187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.489s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:15 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce28b11-946e-44a5-bd9f-72322885648b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cef60e0-bea6-4aca-abbd-bb999c81d477', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:15 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4788d5b-e1d4-4d7d-839d-ac8bfcd5ff50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:15 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-f2aed359-9f1b-450f-bc91-9b19e09eb4ab tempest-SnapshotDependencyTests-1451042187 None] Creating offline snapshot 7eda9ae2-954a-4493-ab8f-0115fc5ff310 of volume 999264d8-7439-43e9-b4a6-713447591238 {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:48:15 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e45f2f0-cb28-4a13-a36a-7e737b90aeea]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f2aed359-9f1b-450f-bc91-9b19e09eb4ab tempest-SnapshotDependencyTests-1451042187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:15 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Volume volume-8cef60e0-bea6-4aca-abbd-bb999c81d477 (8cef60e0-bea6-4aca-abbd-bb999c81d477): created successfully Apr 16 19:48:15 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4788d5b-e1d4-4d7d-839d-ac8bfcd5ff50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:15 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Flow 'volume_create_manager' (93a0fb82-4c90-4daf-b6ba-08f933744076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:48:15 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-79638cd1-7cbc-4b9a-813c-cea1501d5ee6 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.498s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:15 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-79638cd1-7cbc-4b9a-813c-cea1501d5ee6 tempest-VolumesSnapshotTestJSON-1777891004 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:48:15 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-4b98ef09-5ef4-43cf-b348-b17037e5d5b1 tempest-VolumesTransfersV357Test-1389361937 None] Created volume successfully. Apr 16 19:48:15 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-79638cd1-7cbc-4b9a-813c-cea1501d5ee6 tempest-VolumesSnapshotTestJSON-1777891004 None] Deleted volume successfully. Apr 16 19:48:15 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-79638cd1-7cbc-4b9a-813c-cea1501d5ee6 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-a97c5fdd-e5dc-4b55-9538-b0f785b5dea9-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:15 devstack sudo[89278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238 Apr 16 19:48:15 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:16 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bc19964e-c6fc-4f4f-ae9c-643e27f01ec7 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "cinder-e16e07c6-dd2b-4243-9173-340464fd7903-delete_snapshot" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:16 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bc19964e-c6fc-4f4f-ae9c-643e27f01ec7 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-e16e07c6-dd2b-4243-9173-340464fd7903-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:16 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bc19964e-c6fc-4f4f-ae9c-643e27f01ec7 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "cinder-quobyte-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:16 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bc19964e-c6fc-4f4f-ae9c-643e27f01ec7 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:16 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bc19964e-c6fc-4f4f-ae9c-643e27f01ec7 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "cinder-quobyte-e16e07c6-dd2b-4243-9173-340464fd7903" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:16 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bc19964e-c6fc-4f4f-ae9c-643e27f01ec7 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-e16e07c6-dd2b-4243-9173-340464fd7903" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:16 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-bc19964e-c6fc-4f4f-ae9c-643e27f01ec7 tempest-VolumesSnapshotTestJSON-1777891004 None] Deleting offline snapshot e16e07c6-dd2b-4243-9173-340464fd7903 of volume 6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:48:16 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-bc19964e-c6fc-4f4f-ae9c-643e27f01ec7 tempest-VolumesSnapshotTestJSON-1777891004 None] snapshot_file for this snap is: volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.e16e07c6-dd2b-4243-9173-340464fd7903 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:48:16 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12732ac-7da0-48a6-8d79-7bf8ad37201c]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bc19964e-c6fc-4f4f-ae9c-643e27f01ec7 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.e16e07c6-dd2b-4243-9173-340464fd7903 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:16 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f2aed359-9f1b-450f-bc91-9b19e09eb4ab tempest-SnapshotDependencyTests-1451042187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238" returned: 0 in 0.556s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f2aed359-9f1b-450f-bc91-9b19e09eb4ab tempest-SnapshotDependencyTests-1451042187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.7eda9ae2-954a-4493-ab8f-0115fc5ff310 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:16 devstack sudo[89284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.7eda9ae2-954a-4493-ab8f-0115fc5ff310 1G Apr 16 19:48:16 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:16 devstack sudo[89283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.e16e07c6-dd2b-4243-9173-340464fd7903 Apr 16 19:48:16 devstack sudo[89283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:16 devstack sudo[89283]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bc19964e-c6fc-4f4f-ae9c-643e27f01ec7 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.e16e07c6-dd2b-4243-9173-340464fd7903" returned: 0 in 0.584s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:16 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-bc19964e-c6fc-4f4f-ae9c-643e27f01ec7 tempest-VolumesSnapshotTestJSON-1777891004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:48:16 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[785abb34-3188-454a-9d6e-7303366a9c65]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bc19964e-c6fc-4f4f-ae9c-643e27f01ec7 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:16 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f2aed359-9f1b-450f-bc91-9b19e09eb4ab tempest-SnapshotDependencyTests-1451042187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.7eda9ae2-954a-4493-ab8f-0115fc5ff310 1G" returned: 0 in 0.608s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f2aed359-9f1b-450f-bc91-9b19e09eb4ab tempest-SnapshotDependencyTests-1451042187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-999264d8-7439-43e9-b4a6-713447591238 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.7eda9ae2-954a-4493-ab8f-0115fc5ff310 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:16 devstack sudo[89294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-999264d8-7439-43e9-b4a6-713447591238 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.7eda9ae2-954a-4493-ab8f-0115fc5ff310 Apr 16 19:48:16 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:17 devstack sudo[89293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 Apr 16 19:48:17 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:17 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-6eab9771-32a2-46b4-8575-57cbb666300a tempest-VolumesTransfersV357Test-1076371335 None] Transfer volume completed successfully. Apr 16 19:48:17 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bc19964e-c6fc-4f4f-ae9c-643e27f01ec7 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1" returned: 0 in 0.599s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bc19964e-c6fc-4f4f-ae9c-643e27f01ec7 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.e16e07c6-dd2b-4243-9173-340464fd7903 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:17 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f2aed359-9f1b-450f-bc91-9b19e09eb4ab tempest-SnapshotDependencyTests-1451042187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-999264d8-7439-43e9-b4a6-713447591238 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.7eda9ae2-954a-4493-ab8f-0115fc5ff310" returned: 0 in 0.561s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:17 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-f2aed359-9f1b-450f-bc91-9b19e09eb4ab tempest-SnapshotDependencyTests-1451042187 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.7eda9ae2-954a-4493-ab8f-0115fc5ff310 is being set with open permissions: ugo+rw Apr 16 19:48:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f2aed359-9f1b-450f-bc91-9b19e09eb4ab tempest-SnapshotDependencyTests-1451042187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.7eda9ae2-954a-4493-ab8f-0115fc5ff310 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:17 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.e16e07c6-dd2b-4243-9173-340464fd7903 Apr 16 19:48:17 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:17 devstack sudo[89304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.7eda9ae2-954a-4493-ab8f-0115fc5ff310 Apr 16 19:48:17 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:17 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f2aed359-9f1b-450f-bc91-9b19e09eb4ab tempest-SnapshotDependencyTests-1451042187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.7eda9ae2-954a-4493-ab8f-0115fc5ff310" returned: 0 in 0.440s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f2aed359-9f1b-450f-bc91-9b19e09eb4ab tempest-SnapshotDependencyTests-1451042187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:18 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.info Apr 16 19:48:18 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:18 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bc19964e-c6fc-4f4f-ae9c-643e27f01ec7 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.e16e07c6-dd2b-4243-9173-340464fd7903" returned: 0 in 0.529s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bc19964e-c6fc-4f4f-ae9c-643e27f01ec7 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.e16e07c6-dd2b-4243-9173-340464fd7903 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:18 devstack sudo[89313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.e16e07c6-dd2b-4243-9173-340464fd7903 Apr 16 19:48:18 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:18 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1487ea28-5686-4b67-a1db-090204a7d6f8 tempest-VolumesTransfersV357Test-2080583931 None] Acquiring lock "cinder-8cef60e0-bea6-4aca-abbd-bb999c81d477-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:18 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1487ea28-5686-4b67-a1db-090204a7d6f8 tempest-VolumesTransfersV357Test-2080583931 None] Lock "cinder-8cef60e0-bea6-4aca-abbd-bb999c81d477-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:18 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1487ea28-5686-4b67-a1db-090204a7d6f8 tempest-VolumesTransfersV357Test-2080583931 None] Acquiring lock "cinder-quobyte-8cef60e0-bea6-4aca-abbd-bb999c81d477" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:18 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1487ea28-5686-4b67-a1db-090204a7d6f8 tempest-VolumesTransfersV357Test-2080583931 None] Lock "cinder-quobyte-8cef60e0-bea6-4aca-abbd-bb999c81d477" acquired by "delete_volume" :: waited 0.013s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:18 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e110a6-6ec4-438d-a551-994198d0c402]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1487ea28-5686-4b67-a1db-090204a7d6f8 tempest-VolumesTransfersV357Test-2080583931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8cef60e0-bea6-4aca-abbd-bb999c81d477 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:18 devstack sudo[89315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8cef60e0-bea6-4aca-abbd-bb999c81d477 Apr 16 19:48:18 devstack sudo[89315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:18 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f2aed359-9f1b-450f-bc91-9b19e09eb4ab tempest-SnapshotDependencyTests-1451042187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.info" returned: 0 in 0.517s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:18 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-f2aed359-9f1b-450f-bc91-9b19e09eb4ab tempest-SnapshotDependencyTests-1451042187 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.info is being set with open permissions: ugo+rw Apr 16 19:48:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f2aed359-9f1b-450f-bc91-9b19e09eb4ab tempest-SnapshotDependencyTests-1451042187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:18 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.info Apr 16 19:48:18 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:18 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bc19964e-c6fc-4f4f-ae9c-643e27f01ec7 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1.e16e07c6-dd2b-4243-9173-340464fd7903" returned: 0 in 0.511s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:18 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bc19964e-c6fc-4f4f-ae9c-643e27f01ec7 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-e16e07c6-dd2b-4243-9173-340464fd7903" released by "_delete_snapshot" :: held 2.300s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:18 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bc19964e-c6fc-4f4f-ae9c-643e27f01ec7 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1" released by "delete_snapshot" :: held 2.323s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:18 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-bc19964e-c6fc-4f4f-ae9c-643e27f01ec7 tempest-VolumesSnapshotTestJSON-1777891004 None] Created reservations ['9e97b87a-3700-4987-be91-7c5e66334648', '07744217-876a-4afb-8fb7-9fb799ec353e', 'cd807470-1fe1-4acd-ab4b-edbfdb9e395d', 'ee6a0e4c-c4d1-4ebf-a391-06a27e863ff9'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:48:18 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-bc19964e-c6fc-4f4f-ae9c-643e27f01ec7 tempest-VolumesSnapshotTestJSON-1777891004 None] Delete snapshot completed successfully. Apr 16 19:48:18 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bc19964e-c6fc-4f4f-ae9c-643e27f01ec7 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-e16e07c6-dd2b-4243-9173-340464fd7903-delete_snapshot" released by "delete_snapshot" :: held 2.417s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:18 devstack sudo[89315]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1487ea28-5686-4b67-a1db-090204a7d6f8 tempest-VolumesTransfersV357Test-2080583931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8cef60e0-bea6-4aca-abbd-bb999c81d477" returned: 0 in 0.530s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1487ea28-5686-4b67-a1db-090204a7d6f8 tempest-VolumesTransfersV357Test-2080583931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8cef60e0-bea6-4aca-abbd-bb999c81d477 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:18 devstack sudo[89325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8cef60e0-bea6-4aca-abbd-bb999c81d477 Apr 16 19:48:18 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:19 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f2aed359-9f1b-450f-bc91-9b19e09eb4ab tempest-SnapshotDependencyTests-1451042187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.info" returned: 0 in 0.485s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f2aed359-9f1b-450f-bc91-9b19e09eb4ab tempest-SnapshotDependencyTests-1451042187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.275s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:19 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-f2aed359-9f1b-450f-bc91-9b19e09eb4ab tempest-SnapshotDependencyTests-1451042187 None] Create snapshot completed successfully Apr 16 19:48:19 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1487ea28-5686-4b67-a1db-090204a7d6f8 tempest-VolumesTransfersV357Test-2080583931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8cef60e0-bea6-4aca-abbd-bb999c81d477" returned: 0 in 0.498s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1487ea28-5686-4b67-a1db-090204a7d6f8 tempest-VolumesTransfersV357Test-2080583931 None] Lock "cinder-quobyte-8cef60e0-bea6-4aca-abbd-bb999c81d477" released by "delete_volume" :: held 1.064s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-1487ea28-5686-4b67-a1db-090204a7d6f8 tempest-VolumesTransfersV357Test-2080583931 None] Created reservations ['a38aa159-cd4a-44fd-8467-4dd67bd4c57d', '0e4a871a-4674-4b5a-ae92-a61c6da0a263', '7fa549bf-0332-4dfe-94e3-03d8ee6f8f79', '93c7f078-4834-47c0-b3a1-447c43ee7d69'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1487ea28-5686-4b67-a1db-090204a7d6f8 tempest-VolumesTransfersV357Test-2080583931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1487ea28-5686-4b67-a1db-090204a7d6f8 tempest-VolumesTransfersV357Test-2080583931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1487ea28-5686-4b67-a1db-090204a7d6f8 tempest-VolumesTransfersV357Test-2080583931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1487ea28-5686-4b67-a1db-090204a7d6f8 tempest-VolumesTransfersV357Test-2080583931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1487ea28-5686-4b67-a1db-090204a7d6f8 tempest-VolumesTransfersV357Test-2080583931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1487ea28-5686-4b67-a1db-090204a7d6f8 tempest-VolumesTransfersV357Test-2080583931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d11a6c06-0959-4ea3-97ec-f388b6883c28 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "cinder-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:19 devstack sudo[89328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:48:19 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d11a6c06-0959-4ea3-97ec-f388b6883c28 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d11a6c06-0959-4ea3-97ec-f388b6883c28 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "cinder-quobyte-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d11a6c06-0959-4ea3-97ec-f388b6883c28 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1" acquired by "delete_volume" :: waited 0.013s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b85179-479a-425a-9719-b18e160f19db]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d11a6c06-0959-4ea3-97ec-f388b6883c28 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:19 devstack sudo[89330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 Apr 16 19:48:19 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Flow 'volume_create_manager' (152466d8-f7ce-4049-8812-06e5da1f6877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3abae115-c01b-4d69-b27b-9f2eb5f7ac82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3abae115-c01b-4d69-b27b-9f2eb5f7ac82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be702044-2e78-4294-9967-120ad57ad4d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a61bb238d13c49cd999ff098aaa978b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7eda9ae2-954a-4493-ab8f-0115fc5ff310,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:20Z,use_quota=True,user_id='0d323b3dc3e14748bba9cd7215169d37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd9d4dc-d155-4707-884e-663607fa98b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd9d4dc-d155-4707-884e-663607fa98b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (150b84fa-b58c-4963-a55f-4023350f45cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (150b84fa-b58c-4963-a55f-4023350f45cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'be702044-2e78-4294-9967-120ad57ad4d1', 'volume_name': 'volume-be702044-2e78-4294-9967-120ad57ad4d1', 'volume_size': 1, 'snapshot_id': '7eda9ae2-954a-4493-ab8f-0115fc5ff310'}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f533abc9-ef89-4d0a-b1ac-cbde0312d4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f533abc9-ef89-4d0a-b1ac-cbde0312d4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a2bd12b-a5ec-4aa9-bb24-fa8a34859fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:19 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Volume be702044-2e78-4294-9967-120ad57ad4d1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-be702044-2e78-4294-9967-120ad57ad4d1', 'volume_size': 1, 'snapshot_id': '7eda9ae2-954a-4493-ab8f-0115fc5ff310'} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Acquiring lock "cinder-quobyte-7eda9ae2-954a-4493-ab8f-0115fc5ff310-be702044-2e78-4294-9967-120ad57ad4d1" by "_create_volume_from_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Lock "cinder-quobyte-7eda9ae2-954a-4493-ab8f-0115fc5ff310-be702044-2e78-4294-9967-120ad57ad4d1" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Creating volume be702044-2e78-4294-9967-120ad57ad4d1 from snapshot 7eda9ae2-954a-4493-ab8f-0115fc5ff310 {{(pid=82569) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Acquiring lock "cinder-quobyte-be702044-2e78-4294-9967-120ad57ad4d1" by "_copy_volume_from_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Lock "cinder-quobyte-be702044-2e78-4294-9967-120ad57ad4d1" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] snapshot: 7eda9ae2-954a-4493-ab8f-0115fc5ff310, volume: be702044-2e78-4294-9967-120ad57ad4d1, {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[9157b642-d8eb-41e1-b5db-a738cfc0b0fb]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.7eda9ae2-954a-4493-ab8f-0115fc5ff310 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:19 devstack sudo[89332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.7eda9ae2-954a-4493-ab8f-0115fc5ff310 Apr 16 19:48:19 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:20 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1487ea28-5686-4b67-a1db-090204a7d6f8 tempest-VolumesTransfersV357Test-2080583931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.474s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-1487ea28-5686-4b67-a1db-090204a7d6f8 tempest-VolumesTransfersV357Test-2080583931 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:48:20 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-1487ea28-5686-4b67-a1db-090204a7d6f8 tempest-VolumesTransfersV357Test-2080583931 None] Deleted volume successfully. Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1487ea28-5686-4b67-a1db-090204a7d6f8 tempest-VolumesTransfersV357Test-2080583931 None] Lock "cinder-8cef60e0-bea6-4aca-abbd-bb999c81d477-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:20 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d11a6c06-0959-4ea3-97ec-f388b6883c28 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1" returned: 0 in 0.531s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d11a6c06-0959-4ea3-97ec-f388b6883c28 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:20 devstack sudo[89338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1 Apr 16 19:48:20 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:20 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.7eda9ae2-954a-4493-ab8f-0115fc5ff310" returned: 0 in 0.523s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-999264d8-7439-43e9-b4a6-713447591238(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238 {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Creating direct copy from snapshot {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ed0a4e-3c4e-404b-8c08-457f0780e3d0]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:20 devstack sudo[89343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238 Apr 16 19:48:20 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:20 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d11a6c06-0959-4ea3-97ec-f388b6883c28 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1" returned: 0 in 0.510s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d11a6c06-0959-4ea3-97ec-f388b6883c28 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1" released by "delete_volume" :: held 1.075s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-d11a6c06-0959-4ea3-97ec-f388b6883c28 tempest-VolumesSnapshotTestJSON-1777891004 None] Created reservations ['a5da46cd-f274-4828-8aa7-bfa938800858', '7acf6fc7-a785-4ec1-82e3-c824918f57d0', '953b9a41-9c22-4317-ae53-6472d4ee5001', '03e1f6b9-f18e-4481-9aa8-817f6f119179'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d11a6c06-0959-4ea3-97ec-f388b6883c28 tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d11a6c06-0959-4ea3-97ec-f388b6883c28 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d11a6c06-0959-4ea3-97ec-f388b6883c28 tempest-VolumesSnapshotTestJSON-1777891004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d11a6c06-0959-4ea3-97ec-f388b6883c28 tempest-VolumesSnapshotTestJSON-1777891004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d11a6c06-0959-4ea3-97ec-f388b6883c28 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d11a6c06-0959-4ea3-97ec-f388b6883c28 tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:20 devstack sudo[89346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:48:20 devstack sudo[89346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Flow 'volume_create_manager' (7e15d048-370e-4f53-8850-24c177bbba99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d40c2d8b-137d-4791-b7b6-cabeb26d47e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d40c2d8b-137d-4791-b7b6-cabeb26d47e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1042987636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d39ac4e-4918-43a8-81ad-d6b7be37f3c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d62e3d5019840ee98aed9805eecc00c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:21Z,use_quota=True,user_id='c58c72be6570494d9e33a82a5286db52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (749146f0-f5e1-4084-88e7-e5fefe3f8d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (749146f0-f5e1-4084-88e7-e5fefe3f8d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77dd4309-48a2-4f30-8d5a-f65f4af65448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77dd4309-48a2-4f30-8d5a-f65f4af65448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d39ac4e-4918-43a8-81ad-d6b7be37f3c7', 'volume_name': 'volume-2d39ac4e-4918-43a8-81ad-d6b7be37f3c7', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa0fab1f-bebd-4d6f-9f76-a81127d0fef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa0fab1f-bebd-4d6f-9f76-a81127d0fef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (838afdde-0445-4483-881f-4abbc7792b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:20 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Volume 2d39ac4e-4918-43a8-81ad-d6b7be37f3c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d39ac4e-4918-43a8-81ad-d6b7be37f3c7', 'volume_size': 1} Apr 16 19:48:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:21 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238" returned: 0 in 0.575s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:21 devstack cinder-volume[82569]: DEBUG cinder.utils [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Path /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-be702044-2e78-4294-9967-120ad57ad4d1 not found in is_blk_device check {{(pid=82569) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 19:48:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-be702044-2e78-4294-9967-120ad57ad4d1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:21 devstack sudo[89351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-be702044-2e78-4294-9967-120ad57ad4d1 Apr 16 19:48:21 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:21 devstack sudo[89346]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d11a6c06-0959-4ea3-97ec-f388b6883c28 tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.476s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:21 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-d11a6c06-0959-4ea3-97ec-f388b6883c28 tempest-VolumesSnapshotTestJSON-1777891004 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:48:21 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-d11a6c06-0959-4ea3-97ec-f388b6883c28 tempest-VolumesSnapshotTestJSON-1777891004 None] Deleted volume successfully. Apr 16 19:48:21 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d11a6c06-0959-4ea3-97ec-f388b6883c28 tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-6b1a71a5-efa8-4567-b7aa-17ddb8992fd1-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:22 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0469124f-d10f-45f1-8851-f2c924e87cdf tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "cinder-f151e62f-f6cf-407d-b021-226f84142893-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:22 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0469124f-d10f-45f1-8851-f2c924e87cdf tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-f151e62f-f6cf-407d-b021-226f84142893-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:22 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0469124f-d10f-45f1-8851-f2c924e87cdf tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "cinder-quobyte-f151e62f-f6cf-407d-b021-226f84142893" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:22 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0469124f-d10f-45f1-8851-f2c924e87cdf tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-f151e62f-f6cf-407d-b021-226f84142893" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:22 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[600fbc0c-e55c-410f-917c-db56dd6d2521]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0469124f-d10f-45f1-8851-f2c924e87cdf tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:22 devstack sudo[89364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893 Apr 16 19:48:22 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:23 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-be702044-2e78-4294-9967-120ad57ad4d1" returned: 0 in 2.119s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:23 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[d851c626-bf36-416e-afa1-5da818777b22]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:23 devstack sudo[89366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238 Apr 16 19:48:23 devstack sudo[89366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:23 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0469124f-d10f-45f1-8851-f2c924e87cdf tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893" returned: 0 in 1.105s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0469124f-d10f-45f1-8851-f2c924e87cdf tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:23 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893 Apr 16 19:48:23 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:23 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0469124f-d10f-45f1-8851-f2c924e87cdf tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f151e62f-f6cf-407d-b021-226f84142893" returned: 0 in 0.409s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:23 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0469124f-d10f-45f1-8851-f2c924e87cdf tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-quobyte-f151e62f-f6cf-407d-b021-226f84142893" released by "delete_volume" :: held 1.584s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:23 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-0469124f-d10f-45f1-8851-f2c924e87cdf tempest-VolumesSnapshotTestJSON-1777891004 None] Created reservations ['8a0ac246-7b7b-436f-9316-71b1ac5f453d', '72a19d0a-3dde-4a28-89eb-fcf5f7b4cff4', '54d1ccd7-6043-404f-a058-398cee2ecd3e', '9cd73d8a-6ec1-4285-8b35-03d31f240914'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:48:23 devstack sudo[89366]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238" returned: 0 in 0.632s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:23 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Image conversion details: src /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238, size 1024.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-be702044-2e78-4294-9967-120ad57ad4d1 {{(pid=82569) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 19:48:23 devstack cinder-volume[82569]: INFO cinder.image.image_utils [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Converted 1024.00 MB image at 482.79 MB/s Apr 16 19:48:23 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-be702044-2e78-4294-9967-120ad57ad4d1 is being set with open permissions: ugo+rw Apr 16 19:48:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-be702044-2e78-4294-9967-120ad57ad4d1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:23 devstack sudo[89378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-be702044-2e78-4294-9967-120ad57ad4d1 Apr 16 19:48:23 devstack sudo[89378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0469124f-d10f-45f1-8851-f2c924e87cdf tempest-VolumesSnapshotTestJSON-1777891004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0469124f-d10f-45f1-8851-f2c924e87cdf tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0469124f-d10f-45f1-8851-f2c924e87cdf tempest-VolumesSnapshotTestJSON-1777891004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0469124f-d10f-45f1-8851-f2c924e87cdf tempest-VolumesSnapshotTestJSON-1777891004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0469124f-d10f-45f1-8851-f2c924e87cdf tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0469124f-d10f-45f1-8851-f2c924e87cdf tempest-VolumesSnapshotTestJSON-1777891004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:23 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:48:23 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:24 devstack sudo[89378]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-be702044-2e78-4294-9967-120ad57ad4d1" returned: 0 in 0.433s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:24 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Lock "cinder-quobyte-be702044-2e78-4294-9967-120ad57ad4d1" released by "_copy_volume_from_snapshot" :: held 4.349s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:24 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Lock "cinder-quobyte-7eda9ae2-954a-4493-ab8f-0115fc5ff310-be702044-2e78-4294-9967-120ad57ad4d1" released by "_create_volume_from_snapshot" :: held 4.368s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.378s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.278s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:24 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1042987636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d39ac4e-4918-43a8-81ad-d6b7be37f3c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d62e3d5019840ee98aed9805eecc00c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:21Z,use_quota=True,user_id='c58c72be6570494d9e33a82a5286db52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:48:24 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Creating volume 2d39ac4e-4918-43a8-81ad-d6b7be37f3c7 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:48:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:24 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:24 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:24 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:48:24 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:48:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2d39ac4e-4918-43a8-81ad-d6b7be37f3c7 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:24 devstack sudo[89384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2d39ac4e-4918-43a8-81ad-d6b7be37f3c7 1073741824 Apr 16 19:48:24 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:24 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a2bd12b-a5ec-4aa9-bb24-fa8a34859fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be702044-2e78-4294-9967-120ad57ad4d1', 'volume_size': 1, 'snapshot_id': '7eda9ae2-954a-4493-ab8f-0115fc5ff310'}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2797c1e-6c69-4fc5-bfa3-d2b0bbc45c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0469124f-d10f-45f1-8851-f2c924e87cdf tempest-VolumesSnapshotTestJSON-1777891004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.468s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:24 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-0469124f-d10f-45f1-8851-f2c924e87cdf tempest-VolumesSnapshotTestJSON-1777891004 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:48:24 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-0469124f-d10f-45f1-8851-f2c924e87cdf tempest-VolumesSnapshotTestJSON-1777891004 None] Deleted volume successfully. Apr 16 19:48:24 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Volume volume-be702044-2e78-4294-9967-120ad57ad4d1 (be702044-2e78-4294-9967-120ad57ad4d1): created successfully Apr 16 19:48:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2797c1e-6c69-4fc5-bfa3-d2b0bbc45c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Flow 'volume_create_manager' (152466d8-f7ce-4049-8812-06e5da1f6877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:48:24 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0469124f-d10f-45f1-8851-f2c924e87cdf tempest-VolumesSnapshotTestJSON-1777891004 None] Lock "cinder-f151e62f-f6cf-407d-b021-226f84142893-delete_volume" released by "delete_volume" :: held 2.307s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:24 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-99277708-b716-4724-8119-d4039af25867 tempest-SnapshotDependencyTests-1451042187 None] Created volume successfully. Apr 16 19:48:24 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2d39ac4e-4918-43a8-81ad-d6b7be37f3c7 1073741824" returned: 0 in 0.605s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2d39ac4e-4918-43a8-81ad-d6b7be37f3c7 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:24 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2d39ac4e-4918-43a8-81ad-d6b7be37f3c7 Apr 16 19:48:24 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:25 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-302206d5-11c9-4cda-abbf-740801dec47b tempest-SnapshotDependencyTests-1451042187 None] Acquiring lock "cinder-7eda9ae2-954a-4493-ab8f-0115fc5ff310-delete_snapshot" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:25 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-302206d5-11c9-4cda-abbf-740801dec47b tempest-SnapshotDependencyTests-1451042187 None] Lock "cinder-7eda9ae2-954a-4493-ab8f-0115fc5ff310-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:25 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-302206d5-11c9-4cda-abbf-740801dec47b tempest-SnapshotDependencyTests-1451042187 None] Acquiring lock "cinder-quobyte-999264d8-7439-43e9-b4a6-713447591238" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:25 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-302206d5-11c9-4cda-abbf-740801dec47b tempest-SnapshotDependencyTests-1451042187 None] Lock "cinder-quobyte-999264d8-7439-43e9-b4a6-713447591238" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:25 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-302206d5-11c9-4cda-abbf-740801dec47b tempest-SnapshotDependencyTests-1451042187 None] Acquiring lock "cinder-quobyte-7eda9ae2-954a-4493-ab8f-0115fc5ff310" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:25 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-302206d5-11c9-4cda-abbf-740801dec47b tempest-SnapshotDependencyTests-1451042187 None] Lock "cinder-quobyte-7eda9ae2-954a-4493-ab8f-0115fc5ff310" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:25 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-302206d5-11c9-4cda-abbf-740801dec47b tempest-SnapshotDependencyTests-1451042187 None] Deleting offline snapshot 7eda9ae2-954a-4493-ab8f-0115fc5ff310 of volume 999264d8-7439-43e9-b4a6-713447591238 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:48:25 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-302206d5-11c9-4cda-abbf-740801dec47b tempest-SnapshotDependencyTests-1451042187 None] snapshot_file for this snap is: volume-999264d8-7439-43e9-b4a6-713447591238.7eda9ae2-954a-4493-ab8f-0115fc5ff310 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:48:25 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2d39ac4e-4918-43a8-81ad-d6b7be37f3c7" returned: 0 in 0.485s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:25 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:48:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:25 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d980fa-0dc0-40af-b24d-12d5bce64a14]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-302206d5-11c9-4cda-abbf-740801dec47b tempest-SnapshotDependencyTests-1451042187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.7eda9ae2-954a-4493-ab8f-0115fc5ff310 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (838afdde-0445-4483-881f-4abbc7792b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d39ac4e-4918-43a8-81ad-d6b7be37f3c7', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caa79dc9-d539-49a4-a74b-6089854922e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:25 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Volume volume-2d39ac4e-4918-43a8-81ad-d6b7be37f3c7 (2d39ac4e-4918-43a8-81ad-d6b7be37f3c7): created successfully Apr 16 19:48:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caa79dc9-d539-49a4-a74b-6089854922e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Flow 'volume_create_manager' (7e15d048-370e-4f53-8850-24c177bbba99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:48:25 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-d65c3466-a59b-401b-bf67-fbce3dbbcde5 tempest-VolumesTransfersV357Test-1389361937 None] Created volume successfully. Apr 16 19:48:25 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.7eda9ae2-954a-4493-ab8f-0115fc5ff310 Apr 16 19:48:25 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:25 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-302206d5-11c9-4cda-abbf-740801dec47b tempest-SnapshotDependencyTests-1451042187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.7eda9ae2-954a-4493-ab8f-0115fc5ff310" returned: 0 in 0.571s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:25 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-302206d5-11c9-4cda-abbf-740801dec47b tempest-SnapshotDependencyTests-1451042187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-999264d8-7439-43e9-b4a6-713447591238(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:48:25 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[c201e816-e68c-468d-91dc-e30ccdc599bb]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-302206d5-11c9-4cda-abbf-740801dec47b tempest-SnapshotDependencyTests-1451042187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:26 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238 Apr 16 19:48:26 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:26 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:26 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9311af7a-f1d3-4130-b576-6554b332dd4f tempest-VolumesTransfersV357Test-2080583931 None] Acquiring lock "cinder-2d39ac4e-4918-43a8-81ad-d6b7be37f3c7-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-302206d5-11c9-4cda-abbf-740801dec47b tempest-SnapshotDependencyTests-1451042187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238" returned: 0 in 0.652s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-302206d5-11c9-4cda-abbf-740801dec47b tempest-SnapshotDependencyTests-1451042187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.7eda9ae2-954a-4493-ab8f-0115fc5ff310 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:26 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9311af7a-f1d3-4130-b576-6554b332dd4f tempest-VolumesTransfersV357Test-2080583931 None] Lock "cinder-2d39ac4e-4918-43a8-81ad-d6b7be37f3c7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:26 devstack sudo[89403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.7eda9ae2-954a-4493-ab8f-0115fc5ff310 Apr 16 19:48:26 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:26 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9311af7a-f1d3-4130-b576-6554b332dd4f tempest-VolumesTransfersV357Test-2080583931 None] Acquiring lock "cinder-quobyte-2d39ac4e-4918-43a8-81ad-d6b7be37f3c7" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:26 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9311af7a-f1d3-4130-b576-6554b332dd4f tempest-VolumesTransfersV357Test-2080583931 None] Lock "cinder-quobyte-2d39ac4e-4918-43a8-81ad-d6b7be37f3c7" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:26 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2ce92a-c898-43ee-a340-e4a8eb7aa8cc]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9311af7a-f1d3-4130-b576-6554b332dd4f tempest-VolumesTransfersV357Test-2080583931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2d39ac4e-4918-43a8-81ad-d6b7be37f3c7 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:26 devstack sudo[89405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2d39ac4e-4918-43a8-81ad-d6b7be37f3c7 Apr 16 19:48:26 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:27 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-302206d5-11c9-4cda-abbf-740801dec47b tempest-SnapshotDependencyTests-1451042187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.7eda9ae2-954a-4493-ab8f-0115fc5ff310" returned: 0 in 0.611s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-302206d5-11c9-4cda-abbf-740801dec47b tempest-SnapshotDependencyTests-1451042187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.7eda9ae2-954a-4493-ab8f-0115fc5ff310 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:27 devstack sudo[89413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.7eda9ae2-954a-4493-ab8f-0115fc5ff310 Apr 16 19:48:27 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:27 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9311af7a-f1d3-4130-b576-6554b332dd4f tempest-VolumesTransfersV357Test-2080583931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2d39ac4e-4918-43a8-81ad-d6b7be37f3c7" returned: 0 in 0.648s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9311af7a-f1d3-4130-b576-6554b332dd4f tempest-VolumesTransfersV357Test-2080583931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2d39ac4e-4918-43a8-81ad-d6b7be37f3c7 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:27 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2d39ac4e-4918-43a8-81ad-d6b7be37f3c7 Apr 16 19:48:27 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:27 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-302206d5-11c9-4cda-abbf-740801dec47b tempest-SnapshotDependencyTests-1451042187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238.7eda9ae2-954a-4493-ab8f-0115fc5ff310" returned: 0 in 0.503s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:27 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-302206d5-11c9-4cda-abbf-740801dec47b tempest-SnapshotDependencyTests-1451042187 None] Lock "cinder-quobyte-7eda9ae2-954a-4493-ab8f-0115fc5ff310" released by "_delete_snapshot" :: held 2.415s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:27 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-302206d5-11c9-4cda-abbf-740801dec47b tempest-SnapshotDependencyTests-1451042187 None] Lock "cinder-quobyte-999264d8-7439-43e9-b4a6-713447591238" released by "delete_snapshot" :: held 2.429s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:27 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-302206d5-11c9-4cda-abbf-740801dec47b tempest-SnapshotDependencyTests-1451042187 None] Created reservations ['99133fb1-c612-47b0-8ee0-b1da2cbeeda9', 'c06eb513-a983-4de0-809e-16df3ee672b3', '61447fe2-5ca7-40e6-b206-14d98171a2cc', 'e08598c4-29fb-4c01-a9ae-be2d2297075b'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:48:27 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-302206d5-11c9-4cda-abbf-740801dec47b tempest-SnapshotDependencyTests-1451042187 None] Delete snapshot completed successfully. Apr 16 19:48:27 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-302206d5-11c9-4cda-abbf-740801dec47b tempest-SnapshotDependencyTests-1451042187 None] Lock "cinder-7eda9ae2-954a-4493-ab8f-0115fc5ff310-delete_snapshot" released by "delete_snapshot" :: held 2.529s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:27 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9311af7a-f1d3-4130-b576-6554b332dd4f tempest-VolumesTransfersV357Test-2080583931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-2d39ac4e-4918-43a8-81ad-d6b7be37f3c7" returned: 0 in 0.549s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:27 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9311af7a-f1d3-4130-b576-6554b332dd4f tempest-VolumesTransfersV357Test-2080583931 None] Lock "cinder-quobyte-2d39ac4e-4918-43a8-81ad-d6b7be37f3c7" released by "delete_volume" :: held 1.225s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:27 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-9311af7a-f1d3-4130-b576-6554b332dd4f tempest-VolumesTransfersV357Test-2080583931 None] Created reservations ['30f439ef-fc5e-4bbc-86a0-ff8c0777365a', 'f2fee86f-f567-4ccd-b552-6e587d6b18b5', '56e0371f-4132-48b9-8d57-d053b35c7c9d', '3c23c429-1599-4d49-962e-107368a1f3ee'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:48:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9311af7a-f1d3-4130-b576-6554b332dd4f tempest-VolumesTransfersV357Test-2080583931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9311af7a-f1d3-4130-b576-6554b332dd4f tempest-VolumesTransfersV357Test-2080583931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:28 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-9311af7a-f1d3-4130-b576-6554b332dd4f tempest-VolumesTransfersV357Test-2080583931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:28 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-9311af7a-f1d3-4130-b576-6554b332dd4f tempest-VolumesTransfersV357Test-2080583931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9311af7a-f1d3-4130-b576-6554b332dd4f tempest-VolumesTransfersV357Test-2080583931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9311af7a-f1d3-4130-b576-6554b332dd4f tempest-VolumesTransfersV357Test-2080583931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:28 devstack sudo[89420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:48:28 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:28 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9311af7a-f1d3-4130-b576-6554b332dd4f tempest-VolumesTransfersV357Test-2080583931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.504s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:28 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-9311af7a-f1d3-4130-b576-6554b332dd4f tempest-VolumesTransfersV357Test-2080583931 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:48:28 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9242eec0-9467-4517-9f7e-3b112eb35fff tempest-SnapshotDependencyTests-1451042187 None] Acquiring lock "cinder-999264d8-7439-43e9-b4a6-713447591238-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:28 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-9311af7a-f1d3-4130-b576-6554b332dd4f tempest-VolumesTransfersV357Test-2080583931 None] Deleted volume successfully. Apr 16 19:48:28 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9311af7a-f1d3-4130-b576-6554b332dd4f tempest-VolumesTransfersV357Test-2080583931 None] Lock "cinder-2d39ac4e-4918-43a8-81ad-d6b7be37f3c7-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:28 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9242eec0-9467-4517-9f7e-3b112eb35fff tempest-SnapshotDependencyTests-1451042187 None] Lock "cinder-999264d8-7439-43e9-b4a6-713447591238-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:28 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9242eec0-9467-4517-9f7e-3b112eb35fff tempest-SnapshotDependencyTests-1451042187 None] Acquiring lock "cinder-quobyte-999264d8-7439-43e9-b4a6-713447591238" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:28 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9242eec0-9467-4517-9f7e-3b112eb35fff tempest-SnapshotDependencyTests-1451042187 None] Lock "cinder-quobyte-999264d8-7439-43e9-b4a6-713447591238" acquired by "delete_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:28 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f688db-deef-40a6-b962-cef8f6edb67a]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9242eec0-9467-4517-9f7e-3b112eb35fff tempest-SnapshotDependencyTests-1451042187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:28 devstack sudo[89423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238 Apr 16 19:48:28 devstack sudo[89423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:28 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:48:28 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Flow 'volume_create_manager' (9644a9c1-2df6-451e-869e-185f79e4fa55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:48:28 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb25f5ef-b906-4441-8d00-b2bf0a08e401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb25f5ef-b906-4441-8d00-b2bf0a08e401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1590969583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ef3b3a6-2bdb-478e-b900-b64b8f9356f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecdb97268977494f8aba609971b68908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:29Z,use_quota=True,user_id='ad03954a8f5c4de1873ea1975a9139c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d5f202-3ea2-4157-b281-3817fd60a0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d5f202-3ea2-4157-b281-3817fd60a0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a3b932-9f08-405c-8fcd-c23982fdfdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a3b932-9f08-405c-8fcd-c23982fdfdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ef3b3a6-2bdb-478e-b900-b64b8f9356f6', 'volume_name': 'volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6', 'volume_size': 2}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4e3e2ce-ce3a-4065-a10c-0d54b8e9d5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4e3e2ce-ce3a-4065-a10c-0d54b8e9d5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233d1ae5-242c-49de-b898-cd6aaacca959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:29 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Volume 4ef3b3a6-2bdb-478e-b900-b64b8f9356f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6', 'volume_size': 2} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1590969583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ef3b3a6-2bdb-478e-b900-b64b8f9356f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecdb97268977494f8aba609971b68908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:29Z,use_quota=True,user_id='ad03954a8f5c4de1873ea1975a9139c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Creating volume 4ef3b3a6-2bdb-478e-b900-b64b8f9356f6 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:48:29 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6 2147483648 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:29 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6 2147483648 Apr 16 19:48:29 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:29 devstack sudo[89423]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9242eec0-9467-4517-9f7e-3b112eb35fff tempest-SnapshotDependencyTests-1451042187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238" returned: 0 in 0.609s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9242eec0-9467-4517-9f7e-3b112eb35fff tempest-SnapshotDependencyTests-1451042187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:29 devstack sudo[89430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238 Apr 16 19:48:29 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:29 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6 2147483648" returned: 0 in 0.636s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:29 devstack sudo[89436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6 Apr 16 19:48:29 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:29 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9242eec0-9467-4517-9f7e-3b112eb35fff tempest-SnapshotDependencyTests-1451042187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-999264d8-7439-43e9-b4a6-713447591238" returned: 0 in 0.515s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9242eec0-9467-4517-9f7e-3b112eb35fff tempest-SnapshotDependencyTests-1451042187 None] Lock "cinder-quobyte-999264d8-7439-43e9-b4a6-713447591238" released by "delete_volume" :: held 1.164s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-9242eec0-9467-4517-9f7e-3b112eb35fff tempest-SnapshotDependencyTests-1451042187 None] Created reservations ['af627949-371f-4a72-a1a2-554d18a706e7', '91293c41-4bc9-4b85-811e-5538e6145b71', 'd8617135-86e8-4551-a5c0-3f9c757ab84f', '2384dff0-9acf-4453-9161-67f97b63fe6b'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9242eec0-9467-4517-9f7e-3b112eb35fff tempest-SnapshotDependencyTests-1451042187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9242eec0-9467-4517-9f7e-3b112eb35fff tempest-SnapshotDependencyTests-1451042187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-9242eec0-9467-4517-9f7e-3b112eb35fff tempest-SnapshotDependencyTests-1451042187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-9242eec0-9467-4517-9f7e-3b112eb35fff tempest-SnapshotDependencyTests-1451042187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9242eec0-9467-4517-9f7e-3b112eb35fff tempest-SnapshotDependencyTests-1451042187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9242eec0-9467-4517-9f7e-3b112eb35fff tempest-SnapshotDependencyTests-1451042187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:29 devstack sudo[89438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:48:29 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:30 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6" returned: 0 in 0.494s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:48:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233d1ae5-242c-49de-b898-cd6aaacca959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6', 'volume_size': 2}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc715ce-3387-4717-ad20-7a1d10aaf427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:30 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Volume volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6 (4ef3b3a6-2bdb-478e-b900-b64b8f9356f6): created successfully Apr 16 19:48:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc715ce-3387-4717-ad20-7a1d10aaf427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Flow 'volume_create_manager' (9644a9c1-2df6-451e-869e-185f79e4fa55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:48:30 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-9ea2e728-68ed-4227-a871-a9c235333493 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Created volume successfully. Apr 16 19:48:30 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9242eec0-9467-4517-9f7e-3b112eb35fff tempest-SnapshotDependencyTests-1451042187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.507s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:30 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-9242eec0-9467-4517-9f7e-3b112eb35fff tempest-SnapshotDependencyTests-1451042187 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:48:30 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-9242eec0-9467-4517-9f7e-3b112eb35fff tempest-SnapshotDependencyTests-1451042187 None] Deleted volume successfully. Apr 16 19:48:30 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9242eec0-9467-4517-9f7e-3b112eb35fff tempest-SnapshotDependencyTests-1451042187 None] Lock "cinder-999264d8-7439-43e9-b4a6-713447591238-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:30 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d55e649e-e771-4bb9-819b-7be0033819ce tempest-SnapshotDependencyTests-1451042187 None] Acquiring lock "cinder-be702044-2e78-4294-9967-120ad57ad4d1-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:30 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d55e649e-e771-4bb9-819b-7be0033819ce tempest-SnapshotDependencyTests-1451042187 None] Lock "cinder-be702044-2e78-4294-9967-120ad57ad4d1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:30 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d55e649e-e771-4bb9-819b-7be0033819ce tempest-SnapshotDependencyTests-1451042187 None] Acquiring lock "cinder-quobyte-be702044-2e78-4294-9967-120ad57ad4d1" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:30 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d55e649e-e771-4bb9-819b-7be0033819ce tempest-SnapshotDependencyTests-1451042187 None] Lock "cinder-quobyte-be702044-2e78-4294-9967-120ad57ad4d1" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:30 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[5917dadb-66ba-4414-abe2-b15d075bf754]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d55e649e-e771-4bb9-819b-7be0033819ce tempest-SnapshotDependencyTests-1451042187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-be702044-2e78-4294-9967-120ad57ad4d1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:30 devstack sudo[89442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-be702044-2e78-4294-9967-120ad57ad4d1 Apr 16 19:48:30 devstack sudo[89442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5780ca24-9fb0-4852-9c9b-871fec1b0710 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5780ca24-9fb0-4852-9c9b-871fec1b0710 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:31 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-5780ca24-9fb0-4852-9c9b-871fec1b0710 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Creating offline snapshot 2d588d9e-47b8-4d51-98be-76ba543fd28c of volume 4ef3b3a6-2bdb-478e-b900-b64b8f9356f6 {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:48:31 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b6378f-714a-46e8-a04c-541cc1f410ae]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5780ca24-9fb0-4852-9c9b-871fec1b0710 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:31 devstack sudo[89442]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d55e649e-e771-4bb9-819b-7be0033819ce tempest-SnapshotDependencyTests-1451042187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-be702044-2e78-4294-9967-120ad57ad4d1" returned: 0 in 0.577s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d55e649e-e771-4bb9-819b-7be0033819ce tempest-SnapshotDependencyTests-1451042187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-be702044-2e78-4294-9967-120ad57ad4d1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:31 devstack sudo[89447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6 Apr 16 19:48:31 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:31 devstack sudo[89448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-be702044-2e78-4294-9967-120ad57ad4d1 Apr 16 19:48:31 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:31 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5780ca24-9fb0-4852-9c9b-871fec1b0710 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6" returned: 0 in 0.612s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5780ca24-9fb0-4852-9c9b-871fec1b0710 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6.2d588d9e-47b8-4d51-98be-76ba543fd28c 2G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:31 devstack sudo[89455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6.2d588d9e-47b8-4d51-98be-76ba543fd28c 2G Apr 16 19:48:31 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:32 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d55e649e-e771-4bb9-819b-7be0033819ce tempest-SnapshotDependencyTests-1451042187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-be702044-2e78-4294-9967-120ad57ad4d1" returned: 0 in 0.631s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:32 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d55e649e-e771-4bb9-819b-7be0033819ce tempest-SnapshotDependencyTests-1451042187 None] Lock "cinder-quobyte-be702044-2e78-4294-9967-120ad57ad4d1" released by "delete_volume" :: held 1.258s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:32 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-d55e649e-e771-4bb9-819b-7be0033819ce tempest-SnapshotDependencyTests-1451042187 None] Created reservations ['cbf68516-07b5-4d2c-bf45-ce9183b04f37', 'c1c37faf-b804-4c31-9a0d-2c3a4702300d', '50ab25ff-fc6e-42b9-8c00-62a81be469d2', '98554811-5104-4511-81d7-bce1ca98765e'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:48:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d55e649e-e771-4bb9-819b-7be0033819ce tempest-SnapshotDependencyTests-1451042187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d55e649e-e771-4bb9-819b-7be0033819ce tempest-SnapshotDependencyTests-1451042187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:32 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d55e649e-e771-4bb9-819b-7be0033819ce tempest-SnapshotDependencyTests-1451042187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:32 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d55e649e-e771-4bb9-819b-7be0033819ce tempest-SnapshotDependencyTests-1451042187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d55e649e-e771-4bb9-819b-7be0033819ce tempest-SnapshotDependencyTests-1451042187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d55e649e-e771-4bb9-819b-7be0033819ce tempest-SnapshotDependencyTests-1451042187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:32 devstack sudo[89457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:48:32 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:32 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5780ca24-9fb0-4852-9c9b-871fec1b0710 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6.2d588d9e-47b8-4d51-98be-76ba543fd28c 2G" returned: 0 in 0.669s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5780ca24-9fb0-4852-9c9b-871fec1b0710 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6.2d588d9e-47b8-4d51-98be-76ba543fd28c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:32 devstack sudo[89463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6.2d588d9e-47b8-4d51-98be-76ba543fd28c Apr 16 19:48:32 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:32 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d55e649e-e771-4bb9-819b-7be0033819ce tempest-SnapshotDependencyTests-1451042187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.526s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:32 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-d55e649e-e771-4bb9-819b-7be0033819ce tempest-SnapshotDependencyTests-1451042187 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:48:32 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-d55e649e-e771-4bb9-819b-7be0033819ce tempest-SnapshotDependencyTests-1451042187 None] Deleted volume successfully. Apr 16 19:48:32 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-d55e649e-e771-4bb9-819b-7be0033819ce tempest-SnapshotDependencyTests-1451042187 None] Lock "cinder-be702044-2e78-4294-9967-120ad57ad4d1-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:33 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5780ca24-9fb0-4852-9c9b-871fec1b0710 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6.2d588d9e-47b8-4d51-98be-76ba543fd28c" returned: 0 in 0.542s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:33 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-5780ca24-9fb0-4852-9c9b-871fec1b0710 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6.2d588d9e-47b8-4d51-98be-76ba543fd28c is being set with open permissions: ugo+rw Apr 16 19:48:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5780ca24-9fb0-4852-9c9b-871fec1b0710 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6.2d588d9e-47b8-4d51-98be-76ba543fd28c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:33 devstack sudo[89468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6.2d588d9e-47b8-4d51-98be-76ba543fd28c Apr 16 19:48:33 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:33 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:48:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Flow 'volume_create_manager' (aa15d281-2825-4e6f-86ef-5d282624f5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:48:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2786d8-4e62-4f6a-bb9e-6d4cecdecc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2786d8-4e62-4f6a-bb9e-6d4cecdecc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-339563296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d5772d-e519-43a6-b8a5-cbe5900b6cdb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1cd31899219c4bbf976e422b5b9a87a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:33Z,use_quota=True,user_id='ff5a471a662e4e25a2866d20f79f1f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4f29758-3855-4515-91a0-00a023c5190e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4f29758-3855-4515-91a0-00a023c5190e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961c0637-3176-4cf8-b756-f37a268d1645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961c0637-3176-4cf8-b756-f37a268d1645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32d5772d-e519-43a6-b8a5-cbe5900b6cdb', 'volume_name': 'volume-32d5772d-e519-43a6-b8a5-cbe5900b6cdb', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d399dce3-05f3-4772-9439-8f66cb87d213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d399dce3-05f3-4772-9439-8f66cb87d213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (729bd641-0337-4dcc-abe8-7ebfc7a15001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:33 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Volume 32d5772d-e519-43a6-b8a5-cbe5900b6cdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32d5772d-e519-43a6-b8a5-cbe5900b6cdb', 'volume_size': 1} Apr 16 19:48:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:33 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5780ca24-9fb0-4852-9c9b-871fec1b0710 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6.2d588d9e-47b8-4d51-98be-76ba543fd28c" returned: 0 in 0.538s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5780ca24-9fb0-4852-9c9b-871fec1b0710 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:33 devstack sudo[89472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6.info Apr 16 19:48:33 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:34 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5780ca24-9fb0-4852-9c9b-871fec1b0710 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6.info" returned: 0 in 0.497s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:34 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-5780ca24-9fb0-4852-9c9b-871fec1b0710 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6.info is being set with open permissions: ugo+rw Apr 16 19:48:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5780ca24-9fb0-4852-9c9b-871fec1b0710 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:34 devstack sudo[89476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6.info Apr 16 19:48:34 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:34 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5780ca24-9fb0-4852-9c9b-871fec1b0710 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6.info" returned: 0 in 0.493s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5780ca24-9fb0-4852-9c9b-871fec1b0710 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.412s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.354s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-339563296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d5772d-e519-43a6-b8a5-cbe5900b6cdb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1cd31899219c4bbf976e422b5b9a87a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:33Z,use_quota=True,user_id='ff5a471a662e4e25a2866d20f79f1f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:48:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Creating volume 32d5772d-e519-43a6-b8a5-cbe5900b6cdb {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:48:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:48:34 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:48:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-32d5772d-e519-43a6-b8a5-cbe5900b6cdb 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:34 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-5780ca24-9fb0-4852-9c9b-871fec1b0710 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Create snapshot completed successfully Apr 16 19:48:34 devstack sudo[89479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-32d5772d-e519-43a6-b8a5-cbe5900b6cdb 1073741824 Apr 16 19:48:34 devstack sudo[89479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:35 devstack sudo[89479]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-32d5772d-e519-43a6-b8a5-cbe5900b6cdb 1073741824" returned: 0 in 0.674s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-32d5772d-e519-43a6-b8a5-cbe5900b6cdb {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:35 devstack sudo[89484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-32d5772d-e519-43a6-b8a5-cbe5900b6cdb Apr 16 19:48:35 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:35 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c31cbf6e-86db-412f-98de-308fbdafae10 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Acquiring lock "cinder-2d588d9e-47b8-4d51-98be-76ba543fd28c-delete_snapshot" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:35 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c31cbf6e-86db-412f-98de-308fbdafae10 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Lock "cinder-2d588d9e-47b8-4d51-98be-76ba543fd28c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:35 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c31cbf6e-86db-412f-98de-308fbdafae10 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Acquiring lock "cinder-quobyte-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:35 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c31cbf6e-86db-412f-98de-308fbdafae10 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Lock "cinder-quobyte-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:35 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c31cbf6e-86db-412f-98de-308fbdafae10 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Acquiring lock "cinder-quobyte-2d588d9e-47b8-4d51-98be-76ba543fd28c" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:35 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c31cbf6e-86db-412f-98de-308fbdafae10 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Lock "cinder-quobyte-2d588d9e-47b8-4d51-98be-76ba543fd28c" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:35 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-c31cbf6e-86db-412f-98de-308fbdafae10 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Deleting offline snapshot 2d588d9e-47b8-4d51-98be-76ba543fd28c of volume 4ef3b3a6-2bdb-478e-b900-b64b8f9356f6 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:48:35 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-c31cbf6e-86db-412f-98de-308fbdafae10 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] snapshot_file for this snap is: volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6.2d588d9e-47b8-4d51-98be-76ba543fd28c {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:48:35 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d7d37d-62f9-48a8-a6d4-f82bc3668300]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c31cbf6e-86db-412f-98de-308fbdafae10 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6.2d588d9e-47b8-4d51-98be-76ba543fd28c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:35 devstack sudo[89486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6.2d588d9e-47b8-4d51-98be-76ba543fd28c Apr 16 19:48:35 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:35 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-32d5772d-e519-43a6-b8a5-cbe5900b6cdb" returned: 0 in 0.554s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:35 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:48:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (729bd641-0337-4dcc-abe8-7ebfc7a15001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32d5772d-e519-43a6-b8a5-cbe5900b6cdb', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be19bd8-2bd3-4f17-a8c8-fd799af0901f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:36 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Volume volume-32d5772d-e519-43a6-b8a5-cbe5900b6cdb (32d5772d-e519-43a6-b8a5-cbe5900b6cdb): created successfully Apr 16 19:48:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be19bd8-2bd3-4f17-a8c8-fd799af0901f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:36 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Flow 'volume_create_manager' (aa15d281-2825-4e6f-86ef-5d282624f5d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:48:36 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-392d1a23-9d6a-4e73-bdd2-5c43752abd2b tempest-VolumesGetTest-1324821112 None] Created volume successfully. Apr 16 19:48:36 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c31cbf6e-86db-412f-98de-308fbdafae10 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6.2d588d9e-47b8-4d51-98be-76ba543fd28c" returned: 0 in 0.555s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:36 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-c31cbf6e-86db-412f-98de-308fbdafae10 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:48:36 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd7c053-112e-4241-896e-f608bba828d0]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c31cbf6e-86db-412f-98de-308fbdafae10 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:36 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6 Apr 16 19:48:36 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:36 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c31cbf6e-86db-412f-98de-308fbdafae10 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6" returned: 0 in 0.568s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c31cbf6e-86db-412f-98de-308fbdafae10 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6.2d588d9e-47b8-4d51-98be-76ba543fd28c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:36 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6.2d588d9e-47b8-4d51-98be-76ba543fd28c Apr 16 19:48:36 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:36 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Flow 'volume_create_manager' (2708df71-50b9-46d6-8ed6-78f6ecdf2a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0771dbc0-e2bf-49e2-84c4-230132a4a0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0771dbc0-e2bf-49e2-84c4-230132a4a0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:48:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-267125624',display_name='tempest-VolumesGetTest-Volume-19784099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4319b4cb-4502-4eb1-b172-f1373f4f74a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cd31899219c4bbf976e422b5b9a87a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:37Z,use_quota=True,user_id='ff5a471a662e4e25a2866d20f79f1f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d861360-8ad8-497d-9e37-d7d31de6c235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d861360-8ad8-497d-9e37-d7d31de6c235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (597b83b3-1594-4868-9638-655acc4fcb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (597b83b3-1594-4868-9638-655acc4fcb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4319b4cb-4502-4eb1-b172-f1373f4f74a3', 'volume_name': 'volume-4319b4cb-4502-4eb1-b172-f1373f4f74a3', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfd3308b-fa77-471c-a2b0-aa116db37d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfd3308b-fa77-471c-a2b0-aa116db37d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e296aa60-4378-4df7-9625-d2098ee56541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:37 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Volume 4319b4cb-4502-4eb1-b172-f1373f4f74a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4319b4cb-4502-4eb1-b172-f1373f4f74a3', 'volume_size': 1} Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:48:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-267125624',display_name='tempest-VolumesGetTest-Volume-19784099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4319b4cb-4502-4eb1-b172-f1373f4f74a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cd31899219c4bbf976e422b5b9a87a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:37Z,use_quota=True,user_id='ff5a471a662e4e25a2866d20f79f1f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Creating volume 4319b4cb-4502-4eb1-b172-f1373f4f74a3 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:48:37 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4319b4cb-4502-4eb1-b172-f1373f4f74a3 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:37 devstack sudo[89500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4319b4cb-4502-4eb1-b172-f1373f4f74a3 1073741824 Apr 16 19:48:37 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:37 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c31cbf6e-86db-412f-98de-308fbdafae10 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6.2d588d9e-47b8-4d51-98be-76ba543fd28c" returned: 0 in 0.552s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c31cbf6e-86db-412f-98de-308fbdafae10 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6.2d588d9e-47b8-4d51-98be-76ba543fd28c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:37 devstack sudo[89506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6.2d588d9e-47b8-4d51-98be-76ba543fd28c Apr 16 19:48:37 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:37 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4319b4cb-4502-4eb1-b172-f1373f4f74a3 1073741824" returned: 0 in 0.592s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4319b4cb-4502-4eb1-b172-f1373f4f74a3 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:37 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4319b4cb-4502-4eb1-b172-f1373f4f74a3 Apr 16 19:48:37 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:37 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c31cbf6e-86db-412f-98de-308fbdafae10 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6.2d588d9e-47b8-4d51-98be-76ba543fd28c" returned: 0 in 0.511s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c31cbf6e-86db-412f-98de-308fbdafae10 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Lock "cinder-quobyte-2d588d9e-47b8-4d51-98be-76ba543fd28c" released by "_delete_snapshot" :: held 2.254s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c31cbf6e-86db-412f-98de-308fbdafae10 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Lock "cinder-quobyte-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6" released by "delete_snapshot" :: held 2.272s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-c31cbf6e-86db-412f-98de-308fbdafae10 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Created reservations ['d1daf30a-0ae5-4dea-8047-4ca6d9cc0de7', 'e1d5b86b-7b8f-4ac9-860c-5866cbc1c070', 'b6f4775f-c4ff-4b6e-8093-d4c6ae29d42f', '87bba2dd-10bc-491c-861a-619f0a33230f'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:48:37 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-c31cbf6e-86db-412f-98de-308fbdafae10 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Delete snapshot completed successfully. Apr 16 19:48:37 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c31cbf6e-86db-412f-98de-308fbdafae10 tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Lock "cinder-2d588d9e-47b8-4d51-98be-76ba543fd28c-delete_snapshot" released by "delete_snapshot" :: held 2.383s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:38 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4319b4cb-4502-4eb1-b172-f1373f4f74a3" returned: 0 in 0.493s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:38 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:48:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:38 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e296aa60-4378-4df7-9625-d2098ee56541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4319b4cb-4502-4eb1-b172-f1373f4f74a3', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:38 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72de519-4a6b-471f-8e11-43e161209ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:38 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Volume volume-4319b4cb-4502-4eb1-b172-f1373f4f74a3 (4319b4cb-4502-4eb1-b172-f1373f4f74a3): created successfully Apr 16 19:48:38 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72de519-4a6b-471f-8e11-43e161209ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:38 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Flow 'volume_create_manager' (2708df71-50b9-46d6-8ed6-78f6ecdf2a61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:48:38 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-aa5e722b-8c12-4a67-91de-ea1c1f1e8abd tempest-VolumesGetTest-1324821112 None] Created volume successfully. Apr 16 19:48:38 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-24148756-c6d7-49f2-92f4-74105664583c tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Acquiring lock "cinder-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:38 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-24148756-c6d7-49f2-92f4-74105664583c tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Lock "cinder-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:38 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-24148756-c6d7-49f2-92f4-74105664583c tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Acquiring lock "cinder-quobyte-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:38 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-24148756-c6d7-49f2-92f4-74105664583c tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Lock "cinder-quobyte-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6" acquired by "delete_volume" :: waited 0.007s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:38 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae713fe4-cfb8-4d1b-ab7d-5850edfb8ed9]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-24148756-c6d7-49f2-92f4-74105664583c tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:38 devstack sudo[89515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6 Apr 16 19:48:38 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:39 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c86f74e0-ade2-4b60-9110-c55b5762cfc9 tempest-VolumesGetTest-1324821112 None] Acquiring lock "cinder-4319b4cb-4502-4eb1-b172-f1373f4f74a3-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:39 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c86f74e0-ade2-4b60-9110-c55b5762cfc9 tempest-VolumesGetTest-1324821112 None] Lock "cinder-4319b4cb-4502-4eb1-b172-f1373f4f74a3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:39 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c86f74e0-ade2-4b60-9110-c55b5762cfc9 tempest-VolumesGetTest-1324821112 None] Acquiring lock "cinder-quobyte-4319b4cb-4502-4eb1-b172-f1373f4f74a3" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:39 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c86f74e0-ade2-4b60-9110-c55b5762cfc9 tempest-VolumesGetTest-1324821112 None] Lock "cinder-quobyte-4319b4cb-4502-4eb1-b172-f1373f4f74a3" acquired by "delete_volume" :: waited 0.013s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:39 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80339fc-1586-4a73-bea0-77dbb73535e1]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c86f74e0-ade2-4b60-9110-c55b5762cfc9 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4319b4cb-4502-4eb1-b172-f1373f4f74a3 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:39 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4319b4cb-4502-4eb1-b172-f1373f4f74a3 Apr 16 19:48:39 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:39 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-24148756-c6d7-49f2-92f4-74105664583c tempest-VolumesSnapshotNegativeTestJSON-97376341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6" returned: 0 in 0.724s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-24148756-c6d7-49f2-92f4-74105664583c tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:39 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6 Apr 16 19:48:39 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:39 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c86f74e0-ade2-4b60-9110-c55b5762cfc9 tempest-VolumesGetTest-1324821112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4319b4cb-4502-4eb1-b172-f1373f4f74a3" returned: 0 in 0.607s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c86f74e0-ade2-4b60-9110-c55b5762cfc9 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4319b4cb-4502-4eb1-b172-f1373f4f74a3 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:39 devstack sudo[89528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4319b4cb-4502-4eb1-b172-f1373f4f74a3 Apr 16 19:48:39 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:40 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-24148756-c6d7-49f2-92f4-74105664583c tempest-VolumesSnapshotNegativeTestJSON-97376341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6" returned: 0 in 0.570s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:40 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-24148756-c6d7-49f2-92f4-74105664583c tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Lock "cinder-quobyte-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6" released by "delete_volume" :: held 1.338s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:40 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-24148756-c6d7-49f2-92f4-74105664583c tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Created reservations ['f21a8853-4704-4c6f-8016-7217f20ff4c4', '7aed3d88-0abd-4118-b1d2-cf4c08500352', '41aab4ef-b021-4d53-bc75-15d7aa3f096d', 'd45e1dbc-0eee-4189-8491-0448165cdee8'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:48:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-24148756-c6d7-49f2-92f4-74105664583c tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-24148756-c6d7-49f2-92f4-74105664583c tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-24148756-c6d7-49f2-92f4-74105664583c tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-24148756-c6d7-49f2-92f4-74105664583c tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-24148756-c6d7-49f2-92f4-74105664583c tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-24148756-c6d7-49f2-92f4-74105664583c tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:40 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:48:40 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:40 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c86f74e0-ade2-4b60-9110-c55b5762cfc9 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4319b4cb-4502-4eb1-b172-f1373f4f74a3" returned: 0 in 0.572s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:40 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c86f74e0-ade2-4b60-9110-c55b5762cfc9 tempest-VolumesGetTest-1324821112 None] Lock "cinder-quobyte-4319b4cb-4502-4eb1-b172-f1373f4f74a3" released by "delete_volume" :: held 1.203s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:40 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-c86f74e0-ade2-4b60-9110-c55b5762cfc9 tempest-VolumesGetTest-1324821112 None] Created reservations ['799c5e8e-42df-43b5-981d-36b5216a4a35', '5ebbf53a-401e-44b8-8d89-462dce3f2e1b', 'cd3c0210-5a25-4422-a140-89871921ad0b', '1a20e48c-50b2-4f3a-bd5f-fd03e589a5fa'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:48:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-c86f74e0-ade2-4b60-9110-c55b5762cfc9 tempest-VolumesGetTest-1324821112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-c86f74e0-ade2-4b60-9110-c55b5762cfc9 tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-c86f74e0-ade2-4b60-9110-c55b5762cfc9 tempest-VolumesGetTest-1324821112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-c86f74e0-ade2-4b60-9110-c55b5762cfc9 tempest-VolumesGetTest-1324821112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-c86f74e0-ade2-4b60-9110-c55b5762cfc9 tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c86f74e0-ade2-4b60-9110-c55b5762cfc9 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:40 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:48:40 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:40 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-24148756-c6d7-49f2-92f4-74105664583c tempest-VolumesSnapshotNegativeTestJSON-97376341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.567s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:40 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-24148756-c6d7-49f2-92f4-74105664583c tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:48:40 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-24148756-c6d7-49f2-92f4-74105664583c tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Deleted volume successfully. Apr 16 19:48:40 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-24148756-c6d7-49f2-92f4-74105664583c tempest-VolumesSnapshotNegativeTestJSON-97376341 None] Lock "cinder-4ef3b3a6-2bdb-478e-b900-b64b8f9356f6-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:41 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c86f74e0-ade2-4b60-9110-c55b5762cfc9 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.477s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:41 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-c86f74e0-ade2-4b60-9110-c55b5762cfc9 tempest-VolumesGetTest-1324821112 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:48:41 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-c86f74e0-ade2-4b60-9110-c55b5762cfc9 tempest-VolumesGetTest-1324821112 None] Deleted volume successfully. Apr 16 19:48:41 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c86f74e0-ade2-4b60-9110-c55b5762cfc9 tempest-VolumesGetTest-1324821112 None] Lock "cinder-4319b4cb-4502-4eb1-b172-f1373f4f74a3-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:41 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9569ad43-e4cf-415c-a388-464f1f5b5a44 tempest-VolumesGetTest-1324821112 None] Acquiring lock "cinder-32d5772d-e519-43a6-b8a5-cbe5900b6cdb-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:41 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9569ad43-e4cf-415c-a388-464f1f5b5a44 tempest-VolumesGetTest-1324821112 None] Lock "cinder-32d5772d-e519-43a6-b8a5-cbe5900b6cdb-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:41 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9569ad43-e4cf-415c-a388-464f1f5b5a44 tempest-VolumesGetTest-1324821112 None] Acquiring lock "cinder-quobyte-32d5772d-e519-43a6-b8a5-cbe5900b6cdb" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:41 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9569ad43-e4cf-415c-a388-464f1f5b5a44 tempest-VolumesGetTest-1324821112 None] Lock "cinder-quobyte-32d5772d-e519-43a6-b8a5-cbe5900b6cdb" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:41 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9107b7-1ebf-4c4f-83eb-64f4038f96ba]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9569ad43-e4cf-415c-a388-464f1f5b5a44 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-32d5772d-e519-43a6-b8a5-cbe5900b6cdb {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:41 devstack sudo[89538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-32d5772d-e519-43a6-b8a5-cbe5900b6cdb Apr 16 19:48:41 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:42 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9569ad43-e4cf-415c-a388-464f1f5b5a44 tempest-VolumesGetTest-1324821112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-32d5772d-e519-43a6-b8a5-cbe5900b6cdb" returned: 0 in 0.575s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9569ad43-e4cf-415c-a388-464f1f5b5a44 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-32d5772d-e519-43a6-b8a5-cbe5900b6cdb {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:42 devstack sudo[89543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-32d5772d-e519-43a6-b8a5-cbe5900b6cdb Apr 16 19:48:42 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:42 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9569ad43-e4cf-415c-a388-464f1f5b5a44 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-32d5772d-e519-43a6-b8a5-cbe5900b6cdb" returned: 0 in 0.412s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:42 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9569ad43-e4cf-415c-a388-464f1f5b5a44 tempest-VolumesGetTest-1324821112 None] Lock "cinder-quobyte-32d5772d-e519-43a6-b8a5-cbe5900b6cdb" released by "delete_volume" :: held 1.018s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:42 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-9569ad43-e4cf-415c-a388-464f1f5b5a44 tempest-VolumesGetTest-1324821112 None] Created reservations ['16f5e7f0-694a-473f-ad05-d686f94eae89', 'cab0c895-30eb-4623-be5d-e3e4d1071931', '8ad55f3a-cfea-468f-8d90-dbc27dbfac4c', '8ccab8a3-ecd5-419c-9ca9-0f7d424b01fc'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:48:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9569ad43-e4cf-415c-a388-464f1f5b5a44 tempest-VolumesGetTest-1324821112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9569ad43-e4cf-415c-a388-464f1f5b5a44 tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:42 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-9569ad43-e4cf-415c-a388-464f1f5b5a44 tempest-VolumesGetTest-1324821112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:42 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-9569ad43-e4cf-415c-a388-464f1f5b5a44 tempest-VolumesGetTest-1324821112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9569ad43-e4cf-415c-a388-464f1f5b5a44 tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9569ad43-e4cf-415c-a388-464f1f5b5a44 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:42 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:48:42 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:43 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9569ad43-e4cf-415c-a388-464f1f5b5a44 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.411s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:43 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-9569ad43-e4cf-415c-a388-464f1f5b5a44 tempest-VolumesGetTest-1324821112 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:48:43 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-9569ad43-e4cf-415c-a388-464f1f5b5a44 tempest-VolumesGetTest-1324821112 None] Deleted volume successfully. Apr 16 19:48:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9569ad43-e4cf-415c-a388-464f1f5b5a44 tempest-VolumesGetTest-1324821112 None] Lock "cinder-32d5772d-e519-43a6-b8a5-cbe5900b6cdb-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:43 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:48:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Flow 'volume_create_manager' (e4dca3ab-881a-4ba4-bcaf-f8a2e3740e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:48:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb9fc81e-6c84-47a0-91fb-229524ebf27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb9fc81e-6c84-47a0-91fb-229524ebf27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1789909419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b23d05d-fa21-4247-87d4-5e05f076d6b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cd31899219c4bbf976e422b5b9a87a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:44Z,use_quota=True,user_id='ff5a471a662e4e25a2866d20f79f1f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad8a3274-4b95-4f6e-91ac-88b3f76c94c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad8a3274-4b95-4f6e-91ac-88b3f76c94c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aee6594-337b-4543-8e79-a52ce3e80a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:43 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aee6594-337b-4543-8e79-a52ce3e80a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b23d05d-fa21-4247-87d4-5e05f076d6b5', 'volume_name': 'volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:44 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c8504d-3e50-40bb-995f-02f9306df32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:44 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c8504d-3e50-40bb-995f-02f9306df32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:44 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5fa0106-2d8a-4f51-b688-1fb731505a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:44 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Volume 4b23d05d-fa21-4247-87d4-5e05f076d6b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5', 'volume_size': 1} Apr 16 19:48:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1789909419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b23d05d-fa21-4247-87d4-5e05f076d6b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cd31899219c4bbf976e422b5b9a87a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:44Z,use_quota=True,user_id='ff5a471a662e4e25a2866d20f79f1f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:48:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Creating volume 4b23d05d-fa21-4247-87d4-5e05f076d6b5 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:48:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:48:44 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:48:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:44 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5 1073741824 Apr 16 19:48:44 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:44 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5 1073741824" returned: 0 in 0.482s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:44 devstack sudo[89555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5 Apr 16 19:48:44 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:44 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5" returned: 0 in 0.464s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:48:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5fa0106-2d8a-4f51-b688-1fb731505a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a64cb20-5802-4718-bae7-f84723af8e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:45 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Volume volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5 (4b23d05d-fa21-4247-87d4-5e05f076d6b5): created successfully Apr 16 19:48:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a64cb20-5802-4718-bae7-f84723af8e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Flow 'volume_create_manager' (e4dca3ab-881a-4ba4-bcaf-f8a2e3740e71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:48:45 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-bd01d3c7-787a-43ab-b54e-2032731a6a3b tempest-VolumesGetTest-1324821112 None] Created volume successfully. Apr 16 19:48:46 devstack cinder-volume[82569]: DEBUG dbcounter [-] [82569] Writing DB stats cinder:SELECT=162,cinder:INSERT=55,cinder:UPDATE=183,cinder:DELETE=18 {{(pid=82569) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:48:46 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:48:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Flow 'volume_create_manager' (beeb742b-acd9-44a3-9a4f-d6594545bdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:48:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad27db0-192b-4143-96d1-9073630e27b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad27db0-192b-4143-96d1-9073630e27b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1055821188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770c6a97-4417-48b7-8087-e1dfa3c2667d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1cd31899219c4bbf976e422b5b9a87a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4b23d05d-fa21-4247-87d4-5e05f076d6b5,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:46Z,use_quota=True,user_id='ff5a471a662e4e25a2866d20f79f1f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ccdb52-2e23-4da9-815f-ba1ee63a8a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ccdb52-2e23-4da9-815f-ba1ee63a8a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a51455-3a8e-4468-9542-ff52cfe9aca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a51455-3a8e-4468-9542-ff52cfe9aca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '770c6a97-4417-48b7-8087-e1dfa3c2667d', 'volume_name': 'volume-770c6a97-4417-48b7-8087-e1dfa3c2667d', 'volume_size': 1, 'source_volid': '4b23d05d-fa21-4247-87d4-5e05f076d6b5', 'source_volstatus': 'available'}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10454180-d2d4-451b-876d-d963410a5d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10454180-d2d4-451b-876d-d963410a5d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c792e6e3-0664-4f32-b12c-7afe77648ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:46 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Volume 770c6a97-4417-48b7-8087-e1dfa3c2667d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-770c6a97-4417-48b7-8087-e1dfa3c2667d', 'volume_size': 1, 'source_volid': '4b23d05d-fa21-4247-87d4-5e05f076d6b5', 'source_volstatus': 'available'} Apr 16 19:48:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:46 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Cloning volume 4b23d05d-fa21-4247-87d4-5e05f076d6b5 to volume 770c6a97-4417-48b7-8087-e1dfa3c2667d Apr 16 19:48:46 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Creating offline snapshot e50f66d3-57c9-4981-af2d-8d3154446f2a of volume 4b23d05d-fa21-4247-87d4-5e05f076d6b5 {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:48:46 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8943d0-0c58-417a-9bf0-2cbc98f5039a]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:46 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5 Apr 16 19:48:46 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:46 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5" returned: 0 in 0.476s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.e50f66d3-57c9-4981-af2d-8d3154446f2a 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:46 devstack sudo[89563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.e50f66d3-57c9-4981-af2d-8d3154446f2a 1G Apr 16 19:48:46 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:47 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.e50f66d3-57c9-4981-af2d-8d3154446f2a 1G" returned: 0 in 0.467s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.e50f66d3-57c9-4981-af2d-8d3154446f2a {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:47 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.e50f66d3-57c9-4981-af2d-8d3154446f2a Apr 16 19:48:47 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:47 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.e50f66d3-57c9-4981-af2d-8d3154446f2a" returned: 0 in 0.459s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:47 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.e50f66d3-57c9-4981-af2d-8d3154446f2a is being set with open permissions: ugo+rw Apr 16 19:48:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.e50f66d3-57c9-4981-af2d-8d3154446f2a {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:47 devstack sudo[89574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.e50f66d3-57c9-4981-af2d-8d3154446f2a Apr 16 19:48:47 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:48 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.e50f66d3-57c9-4981-af2d-8d3154446f2a" returned: 0 in 0.396s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:48 devstack sudo[89577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.info Apr 16 19:48:48 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:48 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.info" returned: 0 in 0.400s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:48 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.info is being set with open permissions: ugo+rw Apr 16 19:48:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:48 devstack sudo[89580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.info Apr 16 19:48:48 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:49 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.info" returned: 0 in 0.400s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:49 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Acquiring lock "cinder-quobyte-770c6a97-4417-48b7-8087-e1dfa3c2667d" by "_copy_volume_from_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:49 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Lock "cinder-quobyte-770c6a97-4417-48b7-8087-e1dfa3c2667d" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:49 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] snapshot: e50f66d3-57c9-4981-af2d-8d3154446f2a, volume: 770c6a97-4417-48b7-8087-e1dfa3c2667d, {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 19:48:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:49 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:49 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:49 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[56325fe2-fbb5-4a99-9db4-6ef8173c7cf0]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.e50f66d3-57c9-4981-af2d-8d3154446f2a {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:49 devstack sudo[89583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.e50f66d3-57c9-4981-af2d-8d3154446f2a Apr 16 19:48:49 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:49 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.e50f66d3-57c9-4981-af2d-8d3154446f2a" returned: 0 in 0.470s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:49 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:48:49 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5 {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 19:48:49 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Creating direct copy from snapshot {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 19:48:49 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d92a4be-2b87-4157-9602-be486cfd0f4e]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:49 devstack sudo[89588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5 Apr 16 19:48:49 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:50 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5" returned: 0 in 0.442s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:50 devstack cinder-volume[82569]: DEBUG cinder.utils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Path /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-770c6a97-4417-48b7-8087-e1dfa3c2667d not found in is_blk_device check {{(pid=82569) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 19:48:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-770c6a97-4417-48b7-8087-e1dfa3c2667d {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:50 devstack sudo[89593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-770c6a97-4417-48b7-8087-e1dfa3c2667d Apr 16 19:48:50 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:51 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-770c6a97-4417-48b7-8087-e1dfa3c2667d" returned: 0 in 1.902s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:51 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4298174-03c1-411b-a1d8-a2737b7e438e]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:52 devstack sudo[89611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5 Apr 16 19:48:52 devstack sudo[89611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:52 devstack sudo[89611]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5" returned: 0 in 0.588s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:52 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Image conversion details: src /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5, size 1024.00 MB, duration 1.90 sec, destination /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-770c6a97-4417-48b7-8087-e1dfa3c2667d {{(pid=82569) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 19:48:52 devstack cinder-volume[82569]: INFO cinder.image.image_utils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Converted 1024.00 MB image at 538.13 MB/s Apr 16 19:48:52 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-770c6a97-4417-48b7-8087-e1dfa3c2667d is being set with open permissions: ugo+rw Apr 16 19:48:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-770c6a97-4417-48b7-8087-e1dfa3c2667d {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:52 devstack sudo[89616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-770c6a97-4417-48b7-8087-e1dfa3c2667d Apr 16 19:48:52 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:52 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-770c6a97-4417-48b7-8087-e1dfa3c2667d" returned: 0 in 0.431s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:52 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Lock "cinder-quobyte-770c6a97-4417-48b7-8087-e1dfa3c2667d" released by "_copy_volume_from_snapshot" :: held 3.875s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:52 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Acquiring lock "cinder-quobyte-e50f66d3-57c9-4981-af2d-8d3154446f2a" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:53 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Lock "cinder-quobyte-e50f66d3-57c9-4981-af2d-8d3154446f2a" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:53 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Deleting offline snapshot e50f66d3-57c9-4981-af2d-8d3154446f2a of volume 4b23d05d-fa21-4247-87d4-5e05f076d6b5 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:48:53 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] snapshot_file for this snap is: volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.e50f66d3-57c9-4981-af2d-8d3154446f2a {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:48:53 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1958f03-94b7-4fdf-8b6d-4ed1438953e4]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.e50f66d3-57c9-4981-af2d-8d3154446f2a {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:53 devstack sudo[89619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.e50f66d3-57c9-4981-af2d-8d3154446f2a Apr 16 19:48:53 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:53 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.e50f66d3-57c9-4981-af2d-8d3154446f2a" returned: 0 in 0.478s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:53 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:48:53 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54110b8-dc18-4798-a0d2-1f1395dec554]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:53 devstack sudo[89625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5 Apr 16 19:48:53 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:53 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5" returned: 0 in 0.492s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.e50f66d3-57c9-4981-af2d-8d3154446f2a {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:54 devstack sudo[89630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.e50f66d3-57c9-4981-af2d-8d3154446f2a Apr 16 19:48:54 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:54 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.e50f66d3-57c9-4981-af2d-8d3154446f2a" returned: 0 in 0.445s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.e50f66d3-57c9-4981-af2d-8d3154446f2a {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:54 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.e50f66d3-57c9-4981-af2d-8d3154446f2a Apr 16 19:48:54 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:54 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5.e50f66d3-57c9-4981-af2d-8d3154446f2a" returned: 0 in 0.442s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:54 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Lock "cinder-quobyte-e50f66d3-57c9-4981-af2d-8d3154446f2a" released by "_delete_snapshot" :: held 1.905s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:54 devstack cinder-volume[82569]: DEBUG dbcounter [-] [82569] Writing DB stats cinder:SELECT=128,cinder:UPDATE=189,cinder:INSERT=37,cinder:DELETE=13 {{(pid=82569) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:48:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.519s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c792e6e3-0664-4f32-b12c-7afe77648ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-770c6a97-4417-48b7-8087-e1dfa3c2667d', 'volume_size': 1, 'source_volid': '4b23d05d-fa21-4247-87d4-5e05f076d6b5', 'source_volstatus': 'available'}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d70fc24-6caf-45ab-b888-b06147321e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:54 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Volume volume-770c6a97-4417-48b7-8087-e1dfa3c2667d (770c6a97-4417-48b7-8087-e1dfa3c2667d): created successfully Apr 16 19:48:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d70fc24-6caf-45ab-b888-b06147321e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Flow 'volume_create_manager' (beeb742b-acd9-44a3-9a4f-d6594545bdaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:48:54 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-ee653f16-1bd6-4b21-9819-8188bff36e14 tempest-VolumesGetTest-1324821112 None] Created volume successfully. Apr 16 19:48:56 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:48:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Flow 'volume_create_manager' (908d8644-169c-4d67-9f45-3e709a04ab58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:48:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (545f2244-9fd3-4d54-be99-97dc715f35e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (545f2244-9fd3-4d54-be99-97dc715f35e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:48:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-934822887',display_name='tempest-VolumesGetTest-Volume-1429233611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cd31899219c4bbf976e422b5b9a87a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:56Z,use_quota=True,user_id='ff5a471a662e4e25a2866d20f79f1f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc23d436-0611-45cb-959a-460e17b290f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc23d436-0611-45cb-959a-460e17b290f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5463924-ecbe-439e-a032-a25f45550295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5463924-ecbe-439e-a032-a25f45550295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa', 'volume_name': 'volume-ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6095e6bf-c1d8-42ac-80a9-f70da360378f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6095e6bf-c1d8-42ac-80a9-f70da360378f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:56 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d70f467-6812-4c4f-a0ce-f06e9d5b79be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:56 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Volume ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa', 'volume_size': 1} Apr 16 19:48:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:56 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:48:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-934822887',display_name='tempest-VolumesGetTest-Volume-1429233611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cd31899219c4bbf976e422b5b9a87a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:48:56Z,use_quota=True,user_id='ff5a471a662e4e25a2866d20f79f1f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:48:56 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Creating volume ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:48:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:56 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:56 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:56 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:48:56 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:48:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:56 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa 1073741824 Apr 16 19:48:56 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:56 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa 1073741824" returned: 0 in 0.488s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:56 devstack sudo[89643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa Apr 16 19:48:56 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:57 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa" returned: 0 in 0.412s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:57 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:48:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:57 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d70f467-6812-4c4f-a0ce-f06e9d5b79be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:57 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acc71709-5314-42f4-b2d9-8873168ebcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:48:57 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Volume volume-ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa (ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa): created successfully Apr 16 19:48:57 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acc71709-5314-42f4-b2d9-8873168ebcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:48:57 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Flow 'volume_create_manager' (908d8644-169c-4d67-9f45-3e709a04ab58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:48:57 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-5763bc65-c6b8-475b-82a6-ee333fe77e21 tempest-VolumesGetTest-1324821112 None] Created volume successfully. Apr 16 19:48:58 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b73235c3-64aa-41d9-9ba3-969874f7435b tempest-VolumesGetTest-1324821112 None] Acquiring lock "cinder-ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:58 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b73235c3-64aa-41d9-9ba3-969874f7435b tempest-VolumesGetTest-1324821112 None] Lock "cinder-ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:58 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b73235c3-64aa-41d9-9ba3-969874f7435b tempest-VolumesGetTest-1324821112 None] Acquiring lock "cinder-quobyte-ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:58 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b73235c3-64aa-41d9-9ba3-969874f7435b tempest-VolumesGetTest-1324821112 None] Lock "cinder-quobyte-ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa" acquired by "delete_volume" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:58 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49ff2a6-c1dc-4698-9d35-607f4cae12e5]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b73235c3-64aa-41d9-9ba3-969874f7435b tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:58 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa Apr 16 19:48:58 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:59 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b73235c3-64aa-41d9-9ba3-969874f7435b tempest-VolumesGetTest-1324821112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa" returned: 0 in 0.509s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b73235c3-64aa-41d9-9ba3-969874f7435b tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:59 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa Apr 16 19:48:59 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:59 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Apr 16 19:48:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b73235c3-64aa-41d9-9ba3-969874f7435b tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa" returned: 0 in 0.408s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:48:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b73235c3-64aa-41d9-9ba3-969874f7435b tempest-VolumesGetTest-1324821112 None] Lock "cinder-quobyte-ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa" released by "delete_volume" :: held 0.944s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:48:59 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-b73235c3-64aa-41d9-9ba3-969874f7435b tempest-VolumesGetTest-1324821112 None] Created reservations ['d2da6c78-bf16-440d-8bfc-53a0227544ff', 'd591c110-9642-4496-ae05-4e007d1d830d', '025b1c3c-ceb3-4c44-a067-d2e33d568d0a', '31ffb369-e280-4e8d-b303-58c949d9b7f5'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:48:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b73235c3-64aa-41d9-9ba3-969874f7435b tempest-VolumesGetTest-1324821112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:48:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b73235c3-64aa-41d9-9ba3-969874f7435b tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:48:59 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-b73235c3-64aa-41d9-9ba3-969874f7435b tempest-VolumesGetTest-1324821112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:48:59 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-b73235c3-64aa-41d9-9ba3-969874f7435b tempest-VolumesGetTest-1324821112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:48:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b73235c3-64aa-41d9-9ba3-969874f7435b tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:48:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b73235c3-64aa-41d9-9ba3-969874f7435b tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:59 devstack sudo[89655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:48:59 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:48:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a1f3192b-0325-4b91-b224-583bce098699 tempest-VolumesGetTest-1324821112 None] Acquiring lock "cinder-770c6a97-4417-48b7-8087-e1dfa3c2667d-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a1f3192b-0325-4b91-b224-583bce098699 tempest-VolumesGetTest-1324821112 None] Lock "cinder-770c6a97-4417-48b7-8087-e1dfa3c2667d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a1f3192b-0325-4b91-b224-583bce098699 tempest-VolumesGetTest-1324821112 None] Acquiring lock "cinder-quobyte-770c6a97-4417-48b7-8087-e1dfa3c2667d" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:48:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a1f3192b-0325-4b91-b224-583bce098699 tempest-VolumesGetTest-1324821112 None] Lock "cinder-quobyte-770c6a97-4417-48b7-8087-e1dfa3c2667d" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:48:59 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[258da5e7-f829-4e68-81ec-8d401678e442]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:48:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a1f3192b-0325-4b91-b224-583bce098699 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-770c6a97-4417-48b7-8087-e1dfa3c2667d {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:48:59 devstack sudo[89657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-770c6a97-4417-48b7-8087-e1dfa3c2667d Apr 16 19:48:59 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:00 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b73235c3-64aa-41d9-9ba3-969874f7435b tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.448s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:00 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-b73235c3-64aa-41d9-9ba3-969874f7435b tempest-VolumesGetTest-1324821112 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:49:00 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-b73235c3-64aa-41d9-9ba3-969874f7435b tempest-VolumesGetTest-1324821112 None] Deleted volume successfully. Apr 16 19:49:00 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b73235c3-64aa-41d9-9ba3-969874f7435b tempest-VolumesGetTest-1324821112 None] Lock "cinder-ddb16d12-83f8-4bc8-b1f7-9d9c1bf189fa-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:49:00 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a1f3192b-0325-4b91-b224-583bce098699 tempest-VolumesGetTest-1324821112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-770c6a97-4417-48b7-8087-e1dfa3c2667d" returned: 0 in 0.485s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a1f3192b-0325-4b91-b224-583bce098699 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-770c6a97-4417-48b7-8087-e1dfa3c2667d {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:00 devstack sudo[89663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-770c6a97-4417-48b7-8087-e1dfa3c2667d Apr 16 19:49:00 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:00 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a1f3192b-0325-4b91-b224-583bce098699 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-770c6a97-4417-48b7-8087-e1dfa3c2667d" returned: 0 in 0.407s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:00 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a1f3192b-0325-4b91-b224-583bce098699 tempest-VolumesGetTest-1324821112 None] Lock "cinder-quobyte-770c6a97-4417-48b7-8087-e1dfa3c2667d" released by "delete_volume" :: held 0.914s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:49:00 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-a1f3192b-0325-4b91-b224-583bce098699 tempest-VolumesGetTest-1324821112 None] Created reservations ['a65a088f-0851-4abe-8d8c-43c10b36fb9c', '3642c1f1-1049-4145-b5c9-d5c86efc00c4', '4f610d0d-463c-4f60-a6c8-cbbe82b7a48a', '157142d0-439e-412f-80fc-c7a2378fd11e'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:49:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a1f3192b-0325-4b91-b224-583bce098699 tempest-VolumesGetTest-1324821112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a1f3192b-0325-4b91-b224-583bce098699 tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:00 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-a1f3192b-0325-4b91-b224-583bce098699 tempest-VolumesGetTest-1324821112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:49:00 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-a1f3192b-0325-4b91-b224-583bce098699 tempest-VolumesGetTest-1324821112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:49:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a1f3192b-0325-4b91-b224-583bce098699 tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a1f3192b-0325-4b91-b224-583bce098699 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:00 devstack sudo[89666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:49:00 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:00 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-291893cb-23a6-4f8e-9edc-6d8eeb921609 tempest-VolumesGetTest-1324821112 None] Acquiring lock "cinder-4b23d05d-fa21-4247-87d4-5e05f076d6b5-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:49:00 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-291893cb-23a6-4f8e-9edc-6d8eeb921609 tempest-VolumesGetTest-1324821112 None] Lock "cinder-4b23d05d-fa21-4247-87d4-5e05f076d6b5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:49:00 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-291893cb-23a6-4f8e-9edc-6d8eeb921609 tempest-VolumesGetTest-1324821112 None] Acquiring lock "cinder-quobyte-4b23d05d-fa21-4247-87d4-5e05f076d6b5" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:49:00 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-291893cb-23a6-4f8e-9edc-6d8eeb921609 tempest-VolumesGetTest-1324821112 None] Lock "cinder-quobyte-4b23d05d-fa21-4247-87d4-5e05f076d6b5" acquired by "delete_volume" :: waited 0.007s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:49:00 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1c2136-cf70-4d1a-b09f-ccb8da5ffe1f]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:49:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-291893cb-23a6-4f8e-9edc-6d8eeb921609 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:01 devstack sudo[89668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5 Apr 16 19:49:01 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:01 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a1f3192b-0325-4b91-b224-583bce098699 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.420s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:01 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-a1f3192b-0325-4b91-b224-583bce098699 tempest-VolumesGetTest-1324821112 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:49:01 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-a1f3192b-0325-4b91-b224-583bce098699 tempest-VolumesGetTest-1324821112 None] Deleted volume successfully. Apr 16 19:49:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a1f3192b-0325-4b91-b224-583bce098699 tempest-VolumesGetTest-1324821112 None] Lock "cinder-770c6a97-4417-48b7-8087-e1dfa3c2667d-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:49:01 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-291893cb-23a6-4f8e-9edc-6d8eeb921609 tempest-VolumesGetTest-1324821112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5" returned: 0 in 0.477s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-291893cb-23a6-4f8e-9edc-6d8eeb921609 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:01 devstack sudo[89674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5 Apr 16 19:49:01 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:01 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-291893cb-23a6-4f8e-9edc-6d8eeb921609 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-4b23d05d-fa21-4247-87d4-5e05f076d6b5" returned: 0 in 0.421s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-291893cb-23a6-4f8e-9edc-6d8eeb921609 tempest-VolumesGetTest-1324821112 None] Lock "cinder-quobyte-4b23d05d-fa21-4247-87d4-5e05f076d6b5" released by "delete_volume" :: held 0.931s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:49:01 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-291893cb-23a6-4f8e-9edc-6d8eeb921609 tempest-VolumesGetTest-1324821112 None] Created reservations ['58322fe6-1f5c-4638-aaca-349633a4cbf3', 'cd945c2e-28cd-4e5f-b35c-87b2978c5653', '380ce2d9-d3e0-44cd-8dde-1ea26885ddb8', '0d088e30-69ef-4569-851c-3a3df28d0383'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:49:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-291893cb-23a6-4f8e-9edc-6d8eeb921609 tempest-VolumesGetTest-1324821112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-291893cb-23a6-4f8e-9edc-6d8eeb921609 tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:01 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-291893cb-23a6-4f8e-9edc-6d8eeb921609 tempest-VolumesGetTest-1324821112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:49:01 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-291893cb-23a6-4f8e-9edc-6d8eeb921609 tempest-VolumesGetTest-1324821112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:49:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-291893cb-23a6-4f8e-9edc-6d8eeb921609 tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-291893cb-23a6-4f8e-9edc-6d8eeb921609 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:01 devstack sudo[89677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:49:01 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:02 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:49:02 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:02 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Flow 'volume_create_manager' (3851caff-eb8b-4762-8ff6-c6cec3608805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:49:02 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a6664c-6d71-4c08-bb8f-eb91281ee46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-291893cb-23a6-4f8e-9edc-6d8eeb921609 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.499s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:02 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-291893cb-23a6-4f8e-9edc-6d8eeb921609 tempest-VolumesGetTest-1324821112 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:49:02 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-291893cb-23a6-4f8e-9edc-6d8eeb921609 tempest-VolumesGetTest-1324821112 None] Deleted volume successfully. Apr 16 19:49:02 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a6664c-6d71-4c08-bb8f-eb91281ee46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-336822621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944a4625-dea1-4b5a-a131-b7f82f3fb708,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1cd31899219c4bbf976e422b5b9a87a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:02Z,use_quota=True,user_id='ff5a471a662e4e25a2866d20f79f1f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:02 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6bb747f-0406-41d9-a8af-f3e11861523f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:02 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6bb747f-0406-41d9-a8af-f3e11861523f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:02 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b8ede36-8302-4eaf-bd45-9610b846d1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:02 devstack cinder-volume[82569]: DEBUG cinder.image.glance [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Creating Keystone auth plugin from conf {{(pid=82569) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 19:49:02 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-291893cb-23a6-4f8e-9edc-6d8eeb921609 tempest-VolumesGetTest-1324821112 None] Lock "cinder-4b23d05d-fa21-4247-87d4-5e05f076d6b5-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:49:02 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b8ede36-8302-4eaf-bd45-9610b846d1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '944a4625-dea1-4b5a-a131-b7f82f3fb708', 'volume_name': 'volume-944a4625-dea1-4b5a-a131-b7f82f3fb708', 'volume_size': 1, 'image_id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b20df0c408546a0a2fd4c69a0f4b468', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'created_at': datetime.datetime(2026, 4, 16, 17, 35, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 17, 35, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:02 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895c6c54-e523-4aff-8570-058bb6316b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:02 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895c6c54-e523-4aff-8570-058bb6316b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:02 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b8319e-b310-4a42-8ddf-75b5d6593cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:02 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Volume 944a4625-dea1-4b5a-a131-b7f82f3fb708: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-944a4625-dea1-4b5a-a131-b7f82f3fb708', 'volume_size': 1, 'image_id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b20df0c408546a0a2fd4c69a0f4b468', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'created_at': datetime.datetime(2026, 4, 16, 17, 35, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 17, 35, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 19:49:02 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Trying to clone 944a4625-dea1-4b5a-a131-b7f82f3fb708 from image ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'metadata': {}}]). {{(pid=82569) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 19:49:02 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_lu0c73sedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82569) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 19:49:02 devstack cinder-volume[82569]: INFO cinder.image.image_utils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Image download 20.69 MB at 20.69 MB/s Apr 16 19:49:02 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ca3f23-aa71-4c70-a1a3-3949aeab8578]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:49:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_lu0c73sedevstack@QuobyteHD {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:02 devstack sudo[89681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_lu0c73sedevstack@QuobyteHD Apr 16 19:49:02 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:03 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_lu0c73sedevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:03 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Temporary image ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 is fetched for user ff5a471a662e4e25a2866d20f79f1f83. {{(pid=82569) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 19:49:03 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7decd9-4902-48f1-a42c-754c819bb7a6]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:49:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_lu0c73sedevstack@QuobyteHD {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:03 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_lu0c73sedevstack@QuobyteHD Apr 16 19:49:03 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:03 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_lu0c73sedevstack@QuobyteHD" returned: 0 in 0.447s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:03 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-336822621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944a4625-dea1-4b5a-a131-b7f82f3fb708,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1cd31899219c4bbf976e422b5b9a87a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:02Z,use_quota=True,user_id='ff5a471a662e4e25a2866d20f79f1f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:49:03 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Creating volume 944a4625-dea1-4b5a-a131-b7f82f3fb708 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:49:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:03 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:49:03 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:49:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:03 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:49:03 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:49:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:03 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708 1073741824 Apr 16 19:49:03 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:04 devstack cinder-volume[82569]: DEBUG oslo_service.periodic_task [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82569) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 19:49:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:49:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:49:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:04 devstack sudo[89694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:49:04 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:04 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708 1073741824" returned: 0 in 0.498s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:04 devstack sudo[89699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708 Apr 16 19:49:04 devstack sudo[89699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:04 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.451s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:04 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:49:04 devstack sudo[89699]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708" returned: 0 in 0.406s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:49:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:04 devstack cinder-volume[82569]: DEBUG cinder.volume.volume_utils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Attempting download of ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'metadata': {}}])) to volume 944a4625-dea1-4b5a-a131-b7f82f3fb708. {{(pid=82569) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 16 19:49:04 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[da95bf6e-f8ec-4425-8ac2-4348bbbd4c24]: (4, 'raw') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:49:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_a4q3tnzm {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:04 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_a4q3tnzm Apr 16 19:49:04 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:05 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_a4q3tnzm" returned: 0 in 0.429s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_a4q3tnzm {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:05 devstack sudo[89707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_a4q3tnzm Apr 16 19:49:05 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:05 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_a4q3tnzm" returned: 1 in 0.443s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_a4q3tnzm' failed. Not Retrying. {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 19:49:05 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c385854-7bdf-40ad-a2f1-4806d8086498]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:49:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_lu0c73sedevstack@QuobyteHD {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:05 devstack sudo[89711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_lu0c73sedevstack@QuobyteHD Apr 16 19:49:05 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:06 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_lu0c73sedevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:06 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 was qcow2, converting to raw {{(pid=82569) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 19:49:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_lu0c73sedevstack@QuobyteHD /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:06 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_lu0c73sedevstack@QuobyteHD /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708 Apr 16 19:49:06 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:07 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_lu0c73sedevstack@QuobyteHD /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708" returned: 0 in 0.913s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:07 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6_lu0c73sedevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708 {{(pid=82569) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 19:49:07 devstack cinder-volume[82569]: INFO cinder.image.image_utils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Converted 112.00 MB image at 112.00 MB/s Apr 16 19:49:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:07 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708 1G Apr 16 19:49:07 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:07 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708 1G" returned: 0 in 0.427s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:07 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6ba136-1d0b-41f3-8240-dd19231e6f0e]: (4, 'raw') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:49:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:07 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708 Apr 16 19:49:07 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:07 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708" returned: 0 in 0.462s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:08 devstack sudo[89730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708 Apr 16 19:49:08 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:08 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708" returned: 1 in 0.457s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708' failed. Not Retrying. {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 19:49:08 devstack cinder-volume[82569]: DEBUG cinder.volume.volume_utils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Downloaded image ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'metadata': {}}])) to volume 944a4625-dea1-4b5a-a131-b7f82f3fb708 successfully. {{(pid=82569) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 16 19:49:08 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Temporary image ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 for user ff5a471a662e4e25a2866d20f79f1f83 is deleted. {{(pid=82569) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 19:49:08 devstack cinder-volume[82569]: DEBUG cinder.volume.volume_utils [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Marking volume 944a4625-dea1-4b5a-a131-b7f82f3fb708 as bootable. {{(pid=82569) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 16 19:49:08 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Copying metadata from image ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 to 944a4625-dea1-4b5a-a131-b7f82f3fb708. {{(pid=82569) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 19:49:08 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Creating volume glance metadata for volume 944a4625-dea1-4b5a-a131-b7f82f3fb708 backed by image ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82569) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 19:49:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b8319e-b310-4a42-8ddf-75b5d6593cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-944a4625-dea1-4b5a-a131-b7f82f3fb708', 'volume_size': 1, 'image_id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b20df0c408546a0a2fd4c69a0f4b468', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6', 'created_at': datetime.datetime(2026, 4, 16, 17, 35, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 17, 35, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee3d0a31-e6a9-43b9-b6c7-2840db33b0c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (481313b4-0d91-4709-b00d-b03207ca9b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:08 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Volume volume-944a4625-dea1-4b5a-a131-b7f82f3fb708 (944a4625-dea1-4b5a-a131-b7f82f3fb708): created successfully Apr 16 19:49:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (481313b4-0d91-4709-b00d-b03207ca9b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Flow 'volume_create_manager' (3851caff-eb8b-4762-8ff6-c6cec3608805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:49:08 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-40c86d8c-b2bf-4e15-a962-52f83aef8558 tempest-VolumesGetTest-1324821112 None] Created volume successfully. Apr 16 19:49:09 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:49:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Flow 'volume_create_manager' (aaa76c0d-9d77-49eb-bc02-826d8093da35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:49:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fdd13db-23af-4050-a739-65d8aefce5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fdd13db-23af-4050-a739-65d8aefce5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:49:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1600759967',display_name='tempest-VolumesGetTest-Volume-205746464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7509ffc-25ef-4ced-b185-d2e7a67cff13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cd31899219c4bbf976e422b5b9a87a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:09Z,use_quota=True,user_id='ff5a471a662e4e25a2866d20f79f1f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72dcce9-1945-46a1-8ebb-e27f9791cee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72dcce9-1945-46a1-8ebb-e27f9791cee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3679fca-dbfc-43ae-83d7-699063037ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3679fca-dbfc-43ae-83d7-699063037ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7509ffc-25ef-4ced-b185-d2e7a67cff13', 'volume_name': 'volume-c7509ffc-25ef-4ced-b185-d2e7a67cff13', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9e3335-ca0a-4b69-b15d-11c6287ad888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9e3335-ca0a-4b69-b15d-11c6287ad888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b835d5d7-372d-44e1-931e-2f2ec9de4aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:09 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Volume c7509ffc-25ef-4ced-b185-d2e7a67cff13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7509ffc-25ef-4ced-b185-d2e7a67cff13', 'volume_size': 1} Apr 16 19:49:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:09 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:49:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1600759967',display_name='tempest-VolumesGetTest-Volume-205746464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7509ffc-25ef-4ced-b185-d2e7a67cff13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cd31899219c4bbf976e422b5b9a87a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:09Z,use_quota=True,user_id='ff5a471a662e4e25a2866d20f79f1f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:49:09 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Creating volume c7509ffc-25ef-4ced-b185-d2e7a67cff13 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:49:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:09 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:49:09 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:49:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:09 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:49:09 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:49:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7509ffc-25ef-4ced-b185-d2e7a67cff13 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:09 devstack sudo[89735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7509ffc-25ef-4ced-b185-d2e7a67cff13 1073741824 Apr 16 19:49:09 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:09 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7509ffc-25ef-4ced-b185-d2e7a67cff13 1073741824" returned: 0 in 0.535s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7509ffc-25ef-4ced-b185-d2e7a67cff13 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:09 devstack sudo[89742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7509ffc-25ef-4ced-b185-d2e7a67cff13 Apr 16 19:49:09 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:10 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7509ffc-25ef-4ced-b185-d2e7a67cff13" returned: 0 in 0.421s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:10 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:49:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b835d5d7-372d-44e1-931e-2f2ec9de4aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7509ffc-25ef-4ced-b185-d2e7a67cff13', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df948ab-c20c-4df5-8529-8fe051507315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:10 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Volume volume-c7509ffc-25ef-4ced-b185-d2e7a67cff13 (c7509ffc-25ef-4ced-b185-d2e7a67cff13): created successfully Apr 16 19:49:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df948ab-c20c-4df5-8529-8fe051507315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Flow 'volume_create_manager' (aaa76c0d-9d77-49eb-bc02-826d8093da35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:49:10 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-79a9a4eb-f4c9-4a8c-9e63-ac6aa27b0270 tempest-VolumesGetTest-1324821112 None] Created volume successfully. Apr 16 19:49:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5c45c8ed-ba89-4f0e-80dc-ad825ed4adc7 tempest-VolumesGetTest-1324821112 None] Acquiring lock "cinder-c7509ffc-25ef-4ced-b185-d2e7a67cff13-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:49:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5c45c8ed-ba89-4f0e-80dc-ad825ed4adc7 tempest-VolumesGetTest-1324821112 None] Lock "cinder-c7509ffc-25ef-4ced-b185-d2e7a67cff13-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:49:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5c45c8ed-ba89-4f0e-80dc-ad825ed4adc7 tempest-VolumesGetTest-1324821112 None] Acquiring lock "cinder-quobyte-c7509ffc-25ef-4ced-b185-d2e7a67cff13" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:49:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5c45c8ed-ba89-4f0e-80dc-ad825ed4adc7 tempest-VolumesGetTest-1324821112 None] Lock "cinder-quobyte-c7509ffc-25ef-4ced-b185-d2e7a67cff13" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:49:11 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e02bb0f-920d-415e-85d0-a734775756f0]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:49:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5c45c8ed-ba89-4f0e-80dc-ad825ed4adc7 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7509ffc-25ef-4ced-b185-d2e7a67cff13 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:11 devstack sudo[89745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7509ffc-25ef-4ced-b185-d2e7a67cff13 Apr 16 19:49:11 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:11 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5c45c8ed-ba89-4f0e-80dc-ad825ed4adc7 tempest-VolumesGetTest-1324821112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7509ffc-25ef-4ced-b185-d2e7a67cff13" returned: 0 in 0.490s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5c45c8ed-ba89-4f0e-80dc-ad825ed4adc7 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7509ffc-25ef-4ced-b185-d2e7a67cff13 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:11 devstack sudo[89750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7509ffc-25ef-4ced-b185-d2e7a67cff13 Apr 16 19:49:11 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:12 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5c45c8ed-ba89-4f0e-80dc-ad825ed4adc7 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c7509ffc-25ef-4ced-b185-d2e7a67cff13" returned: 0 in 0.416s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:12 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5c45c8ed-ba89-4f0e-80dc-ad825ed4adc7 tempest-VolumesGetTest-1324821112 None] Lock "cinder-quobyte-c7509ffc-25ef-4ced-b185-d2e7a67cff13" released by "delete_volume" :: held 0.930s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:49:12 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-5c45c8ed-ba89-4f0e-80dc-ad825ed4adc7 tempest-VolumesGetTest-1324821112 None] Created reservations ['86a1a679-9cdb-425d-8946-0eb63637d25c', '510a7e84-b14d-4c95-b03b-39bcf42840ea', '92f1e340-069d-4720-818b-b218e06b72da', '55dae448-d1fd-40b9-b6bf-87ee2690142c'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:49:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5c45c8ed-ba89-4f0e-80dc-ad825ed4adc7 tempest-VolumesGetTest-1324821112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5c45c8ed-ba89-4f0e-80dc-ad825ed4adc7 tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:12 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5c45c8ed-ba89-4f0e-80dc-ad825ed4adc7 tempest-VolumesGetTest-1324821112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:49:12 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5c45c8ed-ba89-4f0e-80dc-ad825ed4adc7 tempest-VolumesGetTest-1324821112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:49:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5c45c8ed-ba89-4f0e-80dc-ad825ed4adc7 tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5c45c8ed-ba89-4f0e-80dc-ad825ed4adc7 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:12 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:49:12 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:12 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5a117452-da0d-4254-8589-c36e7910c670 tempest-VolumesGetTest-1324821112 None] Acquiring lock "cinder-944a4625-dea1-4b5a-a131-b7f82f3fb708-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:49:12 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5a117452-da0d-4254-8589-c36e7910c670 tempest-VolumesGetTest-1324821112 None] Lock "cinder-944a4625-dea1-4b5a-a131-b7f82f3fb708-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:49:12 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5a117452-da0d-4254-8589-c36e7910c670 tempest-VolumesGetTest-1324821112 None] Acquiring lock "cinder-quobyte-944a4625-dea1-4b5a-a131-b7f82f3fb708" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:49:12 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5a117452-da0d-4254-8589-c36e7910c670 tempest-VolumesGetTest-1324821112 None] Lock "cinder-quobyte-944a4625-dea1-4b5a-a131-b7f82f3fb708" acquired by "delete_volume" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:49:12 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acfa565-8d1f-4888-9afb-2f088ce46185]: (4, 'raw') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:49:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5a117452-da0d-4254-8589-c36e7910c670 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:12 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708 Apr 16 19:49:12 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:12 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5c45c8ed-ba89-4f0e-80dc-ad825ed4adc7 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.460s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:12 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-5c45c8ed-ba89-4f0e-80dc-ad825ed4adc7 tempest-VolumesGetTest-1324821112 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:49:12 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-5c45c8ed-ba89-4f0e-80dc-ad825ed4adc7 tempest-VolumesGetTest-1324821112 None] Deleted volume successfully. Apr 16 19:49:12 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5c45c8ed-ba89-4f0e-80dc-ad825ed4adc7 tempest-VolumesGetTest-1324821112 None] Lock "cinder-c7509ffc-25ef-4ced-b185-d2e7a67cff13-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:49:13 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5a117452-da0d-4254-8589-c36e7910c670 tempest-VolumesGetTest-1324821112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708" returned: 0 in 0.513s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5a117452-da0d-4254-8589-c36e7910c670 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:13 devstack sudo[89794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708 Apr 16 19:49:13 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:13 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5a117452-da0d-4254-8589-c36e7910c670 tempest-VolumesGetTest-1324821112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708" returned: 1 in 0.478s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5a117452-da0d-4254-8589-c36e7910c670 tempest-VolumesGetTest-1324821112 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708' failed. Not Retrying. {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 19:49:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5a117452-da0d-4254-8589-c36e7910c670 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:13 devstack sudo[89800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708 Apr 16 19:49:13 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:14 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5a117452-da0d-4254-8589-c36e7910c670 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-944a4625-dea1-4b5a-a131-b7f82f3fb708" returned: 0 in 0.438s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:14 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5a117452-da0d-4254-8589-c36e7910c670 tempest-VolumesGetTest-1324821112 None] Lock "cinder-quobyte-944a4625-dea1-4b5a-a131-b7f82f3fb708" released by "delete_volume" :: held 1.471s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:49:14 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-5a117452-da0d-4254-8589-c36e7910c670 tempest-VolumesGetTest-1324821112 None] Created reservations ['54a202a3-51df-438d-b9aa-144acc9d5f4a', '4592a542-7f9b-4605-9a75-109235136295', '687c10ba-cb95-4b6f-884f-d8bdd03ea0c3', 'c8e6be0d-0335-4517-9478-62c521deeada'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:49:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5a117452-da0d-4254-8589-c36e7910c670 tempest-VolumesGetTest-1324821112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5a117452-da0d-4254-8589-c36e7910c670 tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5a117452-da0d-4254-8589-c36e7910c670 tempest-VolumesGetTest-1324821112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:49:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5a117452-da0d-4254-8589-c36e7910c670 tempest-VolumesGetTest-1324821112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:49:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5a117452-da0d-4254-8589-c36e7910c670 tempest-VolumesGetTest-1324821112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5a117452-da0d-4254-8589-c36e7910c670 tempest-VolumesGetTest-1324821112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:14 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:49:14 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:14 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5a117452-da0d-4254-8589-c36e7910c670 tempest-VolumesGetTest-1324821112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.420s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:14 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-5a117452-da0d-4254-8589-c36e7910c670 tempest-VolumesGetTest-1324821112 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:49:14 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-5a117452-da0d-4254-8589-c36e7910c670 tempest-VolumesGetTest-1324821112 None] Deleted volume successfully. Apr 16 19:49:14 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-5a117452-da0d-4254-8589-c36e7910c670 tempest-VolumesGetTest-1324821112 None] Lock "cinder-944a4625-dea1-4b5a-a131-b7f82f3fb708-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:49:16 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:49:16 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Flow 'volume_create_manager' (728c5e2d-56e0-4df3-b714-4369f2ef7230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:49:16 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa4a050-b0ef-438e-94e7-ecee18ceda5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:16 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa4a050-b0ef-438e-94e7-ecee18ceda5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1415587192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=680243c9-e7c3-4efb-a768-ca891ce79230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e522a97c08424885897278d0b0e59105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:16Z,use_quota=True,user_id='38d9e80dfdcd4894b33d0473818c3d54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:16 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b85e6cc7-294b-49b1-897a-f38121ad6144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:16 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b85e6cc7-294b-49b1-897a-f38121ad6144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:16 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b80a2a5b-14fb-4d9c-a2f9-5039473792a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:16 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b80a2a5b-14fb-4d9c-a2f9-5039473792a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '680243c9-e7c3-4efb-a768-ca891ce79230', 'volume_name': 'volume-680243c9-e7c3-4efb-a768-ca891ce79230', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:16 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67528b7-15df-4817-9f19-13c3c97f5c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:16 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67528b7-15df-4817-9f19-13c3c97f5c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:16 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14900446-96a0-4403-a414-a3976ad95d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:16 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Volume 680243c9-e7c3-4efb-a768-ca891ce79230: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-680243c9-e7c3-4efb-a768-ca891ce79230', 'volume_size': 1} Apr 16 19:49:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:16 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1415587192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=680243c9-e7c3-4efb-a768-ca891ce79230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e522a97c08424885897278d0b0e59105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:16Z,use_quota=True,user_id='38d9e80dfdcd4894b33d0473818c3d54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:49:16 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Creating volume 680243c9-e7c3-4efb-a768-ca891ce79230 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:49:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:16 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:49:16 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:49:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:16 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:49:16 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:49:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-680243c9-e7c3-4efb-a768-ca891ce79230 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:16 devstack sudo[89807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-680243c9-e7c3-4efb-a768-ca891ce79230 1073741824 Apr 16 19:49:16 devstack sudo[89807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:16 devstack sudo[89807]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-680243c9-e7c3-4efb-a768-ca891ce79230 1073741824" returned: 0 in 0.463s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-680243c9-e7c3-4efb-a768-ca891ce79230 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:16 devstack sudo[89812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-680243c9-e7c3-4efb-a768-ca891ce79230 Apr 16 19:49:16 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:17 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-680243c9-e7c3-4efb-a768-ca891ce79230" returned: 0 in 0.394s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:17 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:49:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:17 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14900446-96a0-4403-a414-a3976ad95d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-680243c9-e7c3-4efb-a768-ca891ce79230', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:17 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de67972f-5f7b-4842-9839-10c238b672d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:17 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Volume volume-680243c9-e7c3-4efb-a768-ca891ce79230 (680243c9-e7c3-4efb-a768-ca891ce79230): created successfully Apr 16 19:49:17 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de67972f-5f7b-4842-9839-10c238b672d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:17 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Flow 'volume_create_manager' (728c5e2d-56e0-4df3-b714-4369f2ef7230) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:49:17 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-b4b38bc5-c15a-4110-b75c-5edd8672d280 tempest-VolumesNegativeTest-1391779064 None] Created volume successfully. Apr 16 19:49:27 devstack cinder-volume[82569]: DEBUG dbcounter [-] [82569] Writing DB stats cinder:UPDATE=64,cinder:SELECT=40,cinder:DELETE=1,cinder:INSERT=16 {{(pid=82569) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:49:27 devstack cinder-volume[82569]: DEBUG dbcounter [-] [82569] Writing DB stats cinder:SELECT=44,cinder:INSERT=24,cinder:UPDATE=51,cinder:DELETE=9 {{(pid=82569) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:49:41 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b9295204-5bac-44f4-ae64-732818ffbcaf tempest-VolumesNegativeTest-1391779064 None] Acquiring lock "cinder-680243c9-e7c3-4efb-a768-ca891ce79230-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:49:41 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b9295204-5bac-44f4-ae64-732818ffbcaf tempest-VolumesNegativeTest-1391779064 None] Lock "cinder-680243c9-e7c3-4efb-a768-ca891ce79230-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:49:41 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b9295204-5bac-44f4-ae64-732818ffbcaf tempest-VolumesNegativeTest-1391779064 None] Acquiring lock "cinder-quobyte-680243c9-e7c3-4efb-a768-ca891ce79230" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:49:41 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b9295204-5bac-44f4-ae64-732818ffbcaf tempest-VolumesNegativeTest-1391779064 None] Lock "cinder-quobyte-680243c9-e7c3-4efb-a768-ca891ce79230" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:49:41 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[01236206-ce8d-4162-a555-e2daa5586949]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:49:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b9295204-5bac-44f4-ae64-732818ffbcaf tempest-VolumesNegativeTest-1391779064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-680243c9-e7c3-4efb-a768-ca891ce79230 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:41 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-680243c9-e7c3-4efb-a768-ca891ce79230 Apr 16 19:49:41 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:42 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b9295204-5bac-44f4-ae64-732818ffbcaf tempest-VolumesNegativeTest-1391779064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-680243c9-e7c3-4efb-a768-ca891ce79230" returned: 0 in 0.471s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b9295204-5bac-44f4-ae64-732818ffbcaf tempest-VolumesNegativeTest-1391779064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-680243c9-e7c3-4efb-a768-ca891ce79230 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:42 devstack sudo[89905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-680243c9-e7c3-4efb-a768-ca891ce79230 Apr 16 19:49:42 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:42 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b9295204-5bac-44f4-ae64-732818ffbcaf tempest-VolumesNegativeTest-1391779064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-680243c9-e7c3-4efb-a768-ca891ce79230" returned: 0 in 0.404s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:42 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b9295204-5bac-44f4-ae64-732818ffbcaf tempest-VolumesNegativeTest-1391779064 None] Lock "cinder-quobyte-680243c9-e7c3-4efb-a768-ca891ce79230" released by "delete_volume" :: held 0.902s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:49:42 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-b9295204-5bac-44f4-ae64-732818ffbcaf tempest-VolumesNegativeTest-1391779064 None] Created reservations ['f502f7f8-3323-42f2-a550-31a029b8d844', '2896f1fd-ecf9-4b9c-94bc-a07fb3d5b83b', 'f50327b9-5a45-4c9c-a448-1c1ad741c26b', '1a95b717-af8d-484d-9688-6b76074b4ae2'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:49:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b9295204-5bac-44f4-ae64-732818ffbcaf tempest-VolumesNegativeTest-1391779064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b9295204-5bac-44f4-ae64-732818ffbcaf tempest-VolumesNegativeTest-1391779064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:42 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-b9295204-5bac-44f4-ae64-732818ffbcaf tempest-VolumesNegativeTest-1391779064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:49:42 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-b9295204-5bac-44f4-ae64-732818ffbcaf tempest-VolumesNegativeTest-1391779064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:49:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b9295204-5bac-44f4-ae64-732818ffbcaf tempest-VolumesNegativeTest-1391779064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b9295204-5bac-44f4-ae64-732818ffbcaf tempest-VolumesNegativeTest-1391779064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:42 devstack sudo[89908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:49:42 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:43 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b9295204-5bac-44f4-ae64-732818ffbcaf tempest-VolumesNegativeTest-1391779064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.423s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:43 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-b9295204-5bac-44f4-ae64-732818ffbcaf tempest-VolumesNegativeTest-1391779064 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:49:43 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-b9295204-5bac-44f4-ae64-732818ffbcaf tempest-VolumesNegativeTest-1391779064 None] Deleted volume successfully. Apr 16 19:49:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b9295204-5bac-44f4-ae64-732818ffbcaf tempest-VolumesNegativeTest-1391779064 None] Lock "cinder-680243c9-e7c3-4efb-a768-ca891ce79230-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:49:45 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:49:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Flow 'volume_create_manager' (8601c21c-9636-4c86-ba11-a6bdfa741870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:49:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d9c5e0a-3d81-40bd-9942-6a40187bf165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d9c5e0a-3d81-40bd-9942-6a40187bf165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1147421680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0520b46-c593-4c92-9640-a8c3d66075ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2d051cb7d8f4aea84fda5241f75cf99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:45Z,use_quota=True,user_id='a2510ff1031748f7a7bd28e8db0e5b07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ed8251-fc94-4eb4-8875-dc6e1acb756f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ed8251-fc94-4eb4-8875-dc6e1acb756f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20eb054f-36ca-422a-9269-acb8a2385ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20eb054f-36ca-422a-9269-acb8a2385ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0520b46-c593-4c92-9640-a8c3d66075ec', 'volume_name': 'volume-d0520b46-c593-4c92-9640-a8c3d66075ec', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73abd293-202f-4594-86e6-6a27917094b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73abd293-202f-4594-86e6-6a27917094b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf19d936-f40f-4d3c-b04e-a6f4519821df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:45 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Volume d0520b46-c593-4c92-9640-a8c3d66075ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0520b46-c593-4c92-9640-a8c3d66075ec', 'volume_size': 1} Apr 16 19:49:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:45 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1147421680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0520b46-c593-4c92-9640-a8c3d66075ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2d051cb7d8f4aea84fda5241f75cf99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:45Z,use_quota=True,user_id='a2510ff1031748f7a7bd28e8db0e5b07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:49:45 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Creating volume d0520b46-c593-4c92-9640-a8c3d66075ec {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:49:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:45 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:49:45 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:49:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:45 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:49:45 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:49:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d0520b46-c593-4c92-9640-a8c3d66075ec 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:45 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d0520b46-c593-4c92-9640-a8c3d66075ec 1073741824 Apr 16 19:49:45 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:45 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d0520b46-c593-4c92-9640-a8c3d66075ec 1073741824" returned: 0 in 0.479s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d0520b46-c593-4c92-9640-a8c3d66075ec {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:45 devstack sudo[89917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d0520b46-c593-4c92-9640-a8c3d66075ec Apr 16 19:49:45 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:46 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d0520b46-c593-4c92-9640-a8c3d66075ec" returned: 0 in 0.399s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:46 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:49:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf19d936-f40f-4d3c-b04e-a6f4519821df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0520b46-c593-4c92-9640-a8c3d66075ec', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45373188-b445-4d09-9cac-5154b1d90a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:46 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Volume volume-d0520b46-c593-4c92-9640-a8c3d66075ec (d0520b46-c593-4c92-9640-a8c3d66075ec): created successfully Apr 16 19:49:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45373188-b445-4d09-9cac-5154b1d90a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:46 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Flow 'volume_create_manager' (8601c21c-9636-4c86-ba11-a6bdfa741870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:49:46 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-5a8a3ba2-ebcc-4f33-a928-7edcb3f259bb tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Created volume successfully. Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Flow 'volume_create_manager' (307a64a4-0d46-4134-9105-44918fb55c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a0f3f6-2994-4bf3-8c5c-f81c63c4c215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a0f3f6-2994-4bf3-8c5c-f81c63c4c215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1028896197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e51b5620-f399-445a-a5b4-69be150a0d75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2d051cb7d8f4aea84fda5241f75cf99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:48Z,use_quota=True,user_id='a2510ff1031748f7a7bd28e8db0e5b07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12523eae-81ee-4195-ac3b-e7655480c679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12523eae-81ee-4195-ac3b-e7655480c679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e8b9ab-a2f5-44af-91e6-d221a3abfcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e8b9ab-a2f5-44af-91e6-d221a3abfcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e51b5620-f399-445a-a5b4-69be150a0d75', 'volume_name': 'volume-e51b5620-f399-445a-a5b4-69be150a0d75', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda5351a-45c3-4db9-ac61-680b0f69f389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda5351a-45c3-4db9-ac61-680b0f69f389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86fde9e3-acba-475d-a8ce-b1ef177e5ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:47 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Volume e51b5620-f399-445a-a5b4-69be150a0d75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e51b5620-f399-445a-a5b4-69be150a0d75', 'volume_size': 1} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1028896197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e51b5620-f399-445a-a5b4-69be150a0d75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2d051cb7d8f4aea84fda5241f75cf99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:48Z,use_quota=True,user_id='a2510ff1031748f7a7bd28e8db0e5b07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Creating volume e51b5620-f399-445a-a5b4-69be150a0d75 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:49:47 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e51b5620-f399-445a-a5b4-69be150a0d75 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:47 devstack sudo[89920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e51b5620-f399-445a-a5b4-69be150a0d75 1073741824 Apr 16 19:49:47 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Flow 'volume_create_manager' (37303b0d-6089-433b-b7a0-ff1476b3b68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8493a5f0-0827-4c01-8d25-16d4efcb0426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8493a5f0-0827-4c01-8d25-16d4efcb0426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2055977973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e347dc9b-afe5-4d2d-a9a6-4814313adc3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2d051cb7d8f4aea84fda5241f75cf99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:48Z,use_quota=True,user_id='a2510ff1031748f7a7bd28e8db0e5b07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (479a3ce9-6693-4dea-9dad-f3faa1222fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (479a3ce9-6693-4dea-9dad-f3faa1222fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0093c08d-008f-4914-ba35-e68d7a818a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0093c08d-008f-4914-ba35-e68d7a818a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e347dc9b-afe5-4d2d-a9a6-4814313adc3e', 'volume_name': 'volume-e347dc9b-afe5-4d2d-a9a6-4814313adc3e', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f92c7f-7552-4da0-82dd-d6c1f479ae98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f92c7f-7552-4da0-82dd-d6c1f479ae98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f350cb-0343-4b5f-aac0-36175e89bc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:47 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Volume e347dc9b-afe5-4d2d-a9a6-4814313adc3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e347dc9b-afe5-4d2d-a9a6-4814313adc3e', 'volume_size': 1} Apr 16 19:49:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Flow 'volume_create_manager' (90a4ec17-9240-41da-8854-9f22c0434da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (812e334f-51b0-4394-b55d-a49bc8401191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (812e334f-51b0-4394-b55d-a49bc8401191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-556306640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6cfa80e-206b-48a0-afe2-4d9ae3d82364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2d051cb7d8f4aea84fda5241f75cf99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:48Z,use_quota=True,user_id='a2510ff1031748f7a7bd28e8db0e5b07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787f2c08-0e48-4fb3-894c-62e05e42256a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787f2c08-0e48-4fb3-894c-62e05e42256a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b7a839a-c18c-4fab-b629-aed0bef780d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b7a839a-c18c-4fab-b629-aed0bef780d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6cfa80e-206b-48a0-afe2-4d9ae3d82364', 'volume_name': 'volume-a6cfa80e-206b-48a0-afe2-4d9ae3d82364', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d46d7fd3-ee24-49d9-a349-a87985358504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d46d7fd3-ee24-49d9-a349-a87985358504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6510fec4-78fa-4520-bb94-72d3b16dc124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:48 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Volume a6cfa80e-206b-48a0-afe2-4d9ae3d82364: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6cfa80e-206b-48a0-afe2-4d9ae3d82364', 'volume_size': 1} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Flow 'volume_create_manager' (12b769d1-ba43-4b3f-bbce-c59adda0a2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be4e311-81d9-4841-a58f-62b540861eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be4e311-81d9-4841-a58f-62b540861eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-997357114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8137c980-c699-45fa-9699-a6a7b30b1ae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2d051cb7d8f4aea84fda5241f75cf99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:48Z,use_quota=True,user_id='a2510ff1031748f7a7bd28e8db0e5b07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:48 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (144d44a7-f6ff-40e3-8c14-3a128ab42317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (144d44a7-f6ff-40e3-8c14-3a128ab42317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (570967d6-c755-4f64-a3ef-5fb19631b788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (570967d6-c755-4f64-a3ef-5fb19631b788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8137c980-c699-45fa-9699-a6a7b30b1ae1', 'volume_name': 'volume-8137c980-c699-45fa-9699-a6a7b30b1ae1', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ce6dba-015f-4070-a888-5c3740f5b9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ce6dba-015f-4070-a888-5c3740f5b9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c492d7aa-7c8c-49c8-8372-d8f24c4efda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:48 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Volume 8137c980-c699-45fa-9699-a6a7b30b1ae1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8137c980-c699-45fa-9699-a6a7b30b1ae1', 'volume_size': 1} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e51b5620-f399-445a-a5b4-69be150a0d75 1073741824" returned: 0 in 0.637s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e51b5620-f399-445a-a5b4-69be150a0d75 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:48 devstack sudo[89925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e51b5620-f399-445a-a5b4-69be150a0d75 Apr 16 19:49:48 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Flow 'volume_create_manager' (ab11259e-dd05-4ce1-92de-d0ec9102c194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a6d828-bd64-43a6-9e54-f8c5a01e360f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a6d828-bd64-43a6-9e54-f8c5a01e360f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1655811810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46360332-bbd0-4643-bfb1-2d99d01ee62d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2d051cb7d8f4aea84fda5241f75cf99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:48Z,use_quota=True,user_id='a2510ff1031748f7a7bd28e8db0e5b07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f838e4a7-2698-452d-a500-470cde8341d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f838e4a7-2698-452d-a500-470cde8341d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (964da219-578d-4b13-a25f-7c74ad0bb1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (964da219-578d-4b13-a25f-7c74ad0bb1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46360332-bbd0-4643-bfb1-2d99d01ee62d', 'volume_name': 'volume-46360332-bbd0-4643-bfb1-2d99d01ee62d', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (915679d2-35d3-4fbe-949f-ab7790640e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (915679d2-35d3-4fbe-949f-ab7790640e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886e157d-1731-4840-b0c2-b419678d8475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:48 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Volume 46360332-bbd0-4643-bfb1-2d99d01ee62d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46360332-bbd0-4643-bfb1-2d99d01ee62d', 'volume_size': 1} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:48 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e51b5620-f399-445a-a5b4-69be150a0d75" returned: 0 in 0.463s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.932s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2055977973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e347dc9b-afe5-4d2d-a9a6-4814313adc3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2d051cb7d8f4aea84fda5241f75cf99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:48Z,use_quota=True,user_id='a2510ff1031748f7a7bd28e8db0e5b07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Creating volume e347dc9b-afe5-4d2d-a9a6-4814313adc3e {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:49:48 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e347dc9b-afe5-4d2d-a9a6-4814313adc3e 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86fde9e3-acba-475d-a8ce-b1ef177e5ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e51b5620-f399-445a-a5b4-69be150a0d75', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:48 devstack sudo[89929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e347dc9b-afe5-4d2d-a9a6-4814313adc3e 1073741824 Apr 16 19:49:48 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2c6239-4c5c-4a26-b7d4-652a120246ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:48 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Volume volume-e51b5620-f399-445a-a5b4-69be150a0d75 (e51b5620-f399-445a-a5b4-69be150a0d75): created successfully Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2c6239-4c5c-4a26-b7d4-652a120246ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:48 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Flow 'volume_create_manager' (307a64a4-0d46-4134-9105-44918fb55c23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:49:48 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-e8327e8b-76ad-4364-aa54-8f0da99cb39d tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Created volume successfully. Apr 16 19:49:49 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e347dc9b-afe5-4d2d-a9a6-4814313adc3e 1073741824" returned: 0 in 0.485s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e347dc9b-afe5-4d2d-a9a6-4814313adc3e {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:49 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e347dc9b-afe5-4d2d-a9a6-4814313adc3e Apr 16 19:49:49 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:49 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e347dc9b-afe5-4d2d-a9a6-4814313adc3e" returned: 0 in 0.419s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:49 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:49:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.618s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:49 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-556306640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6cfa80e-206b-48a0-afe2-4d9ae3d82364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2d051cb7d8f4aea84fda5241f75cf99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:48Z,use_quota=True,user_id='a2510ff1031748f7a7bd28e8db0e5b07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:49:49 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Creating volume a6cfa80e-206b-48a0-afe2-4d9ae3d82364 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:49:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:49 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:49:49 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:49:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:49 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:49:49 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:49:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a6cfa80e-206b-48a0-afe2-4d9ae3d82364 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f350cb-0343-4b5f-aac0-36175e89bc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e347dc9b-afe5-4d2d-a9a6-4814313adc3e', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e16f4c9-8479-485e-9d24-354ac8b9532d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:49 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a6cfa80e-206b-48a0-afe2-4d9ae3d82364 1073741824 Apr 16 19:49:49 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:49 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Volume volume-e347dc9b-afe5-4d2d-a9a6-4814313adc3e (e347dc9b-afe5-4d2d-a9a6-4814313adc3e): created successfully Apr 16 19:49:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e16f4c9-8479-485e-9d24-354ac8b9532d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:49 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Flow 'volume_create_manager' (37303b0d-6089-433b-b7a0-ff1476b3b68e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:49:49 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-302cc376-d3bd-4f04-b923-07d09e054a47 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Created volume successfully. Apr 16 19:49:50 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a6cfa80e-206b-48a0-afe2-4d9ae3d82364 1073741824" returned: 0 in 0.486s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a6cfa80e-206b-48a0-afe2-4d9ae3d82364 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:50 devstack sudo[89942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a6cfa80e-206b-48a0-afe2-4d9ae3d82364 Apr 16 19:49:50 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:50 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a6cfa80e-206b-48a0-afe2-4d9ae3d82364" returned: 0 in 0.444s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:49:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.382s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-997357114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8137c980-c699-45fa-9699-a6a7b30b1ae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2d051cb7d8f4aea84fda5241f75cf99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:48Z,use_quota=True,user_id='a2510ff1031748f7a7bd28e8db0e5b07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:49:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Creating volume 8137c980-c699-45fa-9699-a6a7b30b1ae1 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:49:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:49:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:49:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:49:50 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:49:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8137c980-c699-45fa-9699-a6a7b30b1ae1 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:50 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6510fec4-78fa-4520-bb94-72d3b16dc124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6cfa80e-206b-48a0-afe2-4d9ae3d82364', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:50 devstack sudo[89945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8137c980-c699-45fa-9699-a6a7b30b1ae1 1073741824 Apr 16 19:49:50 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:50 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe26d531-0c6b-4c05-8f2d-369df360b0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:50 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Volume volume-a6cfa80e-206b-48a0-afe2-4d9ae3d82364 (a6cfa80e-206b-48a0-afe2-4d9ae3d82364): created successfully Apr 16 19:49:50 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe26d531-0c6b-4c05-8f2d-369df360b0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:50 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Flow 'volume_create_manager' (90a4ec17-9240-41da-8854-9f22c0434da8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:49:50 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-40e51d1c-bf1e-418c-9b18-ca5464d18284 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Created volume successfully. Apr 16 19:49:51 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8137c980-c699-45fa-9699-a6a7b30b1ae1 1073741824" returned: 0 in 0.481s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8137c980-c699-45fa-9699-a6a7b30b1ae1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:51 devstack sudo[89950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8137c980-c699-45fa-9699-a6a7b30b1ae1 Apr 16 19:49:51 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:51 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8137c980-c699-45fa-9699-a6a7b30b1ae1" returned: 0 in 0.412s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:51 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:49:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.096s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:51 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1655811810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46360332-bbd0-4643-bfb1-2d99d01ee62d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2d051cb7d8f4aea84fda5241f75cf99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:49:48Z,use_quota=True,user_id='a2510ff1031748f7a7bd28e8db0e5b07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:49:51 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Creating volume 46360332-bbd0-4643-bfb1-2d99d01ee62d {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:49:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:51 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:49:51 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:49:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:51 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:49:51 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:49:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-46360332-bbd0-4643-bfb1-2d99d01ee62d 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c492d7aa-7c8c-49c8-8372-d8f24c4efda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8137c980-c699-45fa-9699-a6a7b30b1ae1', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:51 devstack sudo[89959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-46360332-bbd0-4643-bfb1-2d99d01ee62d 1073741824 Apr 16 19:49:51 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7464f6a4-fc44-4839-aab3-529438cf5691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:51 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Volume volume-8137c980-c699-45fa-9699-a6a7b30b1ae1 (8137c980-c699-45fa-9699-a6a7b30b1ae1): created successfully Apr 16 19:49:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7464f6a4-fc44-4839-aab3-529438cf5691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Flow 'volume_create_manager' (12b769d1-ba43-4b3f-bbce-c59adda0a2ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:49:51 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-3459e8e9-f4fd-4619-ac73-fbf205ec163f tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Created volume successfully. Apr 16 19:49:52 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-46360332-bbd0-4643-bfb1-2d99d01ee62d 1073741824" returned: 0 in 0.471s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-46360332-bbd0-4643-bfb1-2d99d01ee62d {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:52 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-46360332-bbd0-4643-bfb1-2d99d01ee62d Apr 16 19:49:52 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:52 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-46360332-bbd0-4643-bfb1-2d99d01ee62d" returned: 0 in 0.411s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:52 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:49:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:52 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886e157d-1731-4840-b0c2-b419678d8475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46360332-bbd0-4643-bfb1-2d99d01ee62d', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:52 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3056a7cb-00f0-44e1-a6f9-cf34390db318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:49:52 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Volume volume-46360332-bbd0-4643-bfb1-2d99d01ee62d (46360332-bbd0-4643-bfb1-2d99d01ee62d): created successfully Apr 16 19:49:52 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3056a7cb-00f0-44e1-a6f9-cf34390db318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:49:52 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Flow 'volume_create_manager' (ab11259e-dd05-4ce1-92de-d0ec9102c194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:49:52 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-7247d568-8579-4e61-a261-bb49b08c0276 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Created volume successfully. Apr 16 19:49:52 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-262da271-e0ce-45e9-a050-85b76e44b448 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "cinder-46360332-bbd0-4643-bfb1-2d99d01ee62d-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:49:52 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-262da271-e0ce-45e9-a050-85b76e44b448 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "cinder-46360332-bbd0-4643-bfb1-2d99d01ee62d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:49:52 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-262da271-e0ce-45e9-a050-85b76e44b448 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "cinder-quobyte-46360332-bbd0-4643-bfb1-2d99d01ee62d" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:49:52 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-262da271-e0ce-45e9-a050-85b76e44b448 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "cinder-quobyte-46360332-bbd0-4643-bfb1-2d99d01ee62d" acquired by "delete_volume" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:49:52 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13f09cd-a41a-4e7a-a0da-a16ecc9ffd19]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:49:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-262da271-e0ce-45e9-a050-85b76e44b448 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-46360332-bbd0-4643-bfb1-2d99d01ee62d {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:53 devstack sudo[89967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-46360332-bbd0-4643-bfb1-2d99d01ee62d Apr 16 19:49:53 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:53 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-262da271-e0ce-45e9-a050-85b76e44b448 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-46360332-bbd0-4643-bfb1-2d99d01ee62d" returned: 0 in 0.486s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-262da271-e0ce-45e9-a050-85b76e44b448 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-46360332-bbd0-4643-bfb1-2d99d01ee62d {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:53 devstack sudo[89973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-46360332-bbd0-4643-bfb1-2d99d01ee62d Apr 16 19:49:53 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:53 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-262da271-e0ce-45e9-a050-85b76e44b448 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-46360332-bbd0-4643-bfb1-2d99d01ee62d" returned: 0 in 0.407s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:53 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-262da271-e0ce-45e9-a050-85b76e44b448 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "cinder-quobyte-46360332-bbd0-4643-bfb1-2d99d01ee62d" released by "delete_volume" :: held 0.927s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:49:53 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-262da271-e0ce-45e9-a050-85b76e44b448 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Created reservations ['b3088484-14ce-4cf6-a0cd-1772c4a694c2', '91c0698e-070a-436d-8d99-6c0abec262f4', '164fe681-03c0-4c7c-a70a-e50daea3a136', '275e4f6e-c7d7-42cc-81e5-1f789ae9fc07'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:49:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-262da271-e0ce-45e9-a050-85b76e44b448 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-262da271-e0ce-45e9-a050-85b76e44b448 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:53 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-262da271-e0ce-45e9-a050-85b76e44b448 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:49:53 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-262da271-e0ce-45e9-a050-85b76e44b448 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:49:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-262da271-e0ce-45e9-a050-85b76e44b448 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-262da271-e0ce-45e9-a050-85b76e44b448 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:53 devstack sudo[89976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:49:53 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:54 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-941da42e-17d7-4e1e-b358-50f22888d2ca tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "cinder-8137c980-c699-45fa-9699-a6a7b30b1ae1-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:49:54 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-941da42e-17d7-4e1e-b358-50f22888d2ca tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "cinder-8137c980-c699-45fa-9699-a6a7b30b1ae1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:49:54 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-941da42e-17d7-4e1e-b358-50f22888d2ca tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "cinder-quobyte-8137c980-c699-45fa-9699-a6a7b30b1ae1" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:49:54 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-941da42e-17d7-4e1e-b358-50f22888d2ca tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "cinder-quobyte-8137c980-c699-45fa-9699-a6a7b30b1ae1" acquired by "delete_volume" :: waited 0.019s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:49:54 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[42488d3f-7217-4853-a378-4d6da24af2ce]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:49:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-941da42e-17d7-4e1e-b358-50f22888d2ca tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8137c980-c699-45fa-9699-a6a7b30b1ae1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:54 devstack sudo[89978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8137c980-c699-45fa-9699-a6a7b30b1ae1 Apr 16 19:49:54 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:54 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-262da271-e0ce-45e9-a050-85b76e44b448 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.523s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:54 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-262da271-e0ce-45e9-a050-85b76e44b448 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:49:54 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-262da271-e0ce-45e9-a050-85b76e44b448 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Deleted volume successfully. Apr 16 19:49:54 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-262da271-e0ce-45e9-a050-85b76e44b448 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "cinder-46360332-bbd0-4643-bfb1-2d99d01ee62d-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:49:54 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-941da42e-17d7-4e1e-b358-50f22888d2ca tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8137c980-c699-45fa-9699-a6a7b30b1ae1" returned: 0 in 0.499s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-941da42e-17d7-4e1e-b358-50f22888d2ca tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8137c980-c699-45fa-9699-a6a7b30b1ae1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:54 devstack sudo[89984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8137c980-c699-45fa-9699-a6a7b30b1ae1 Apr 16 19:49:54 devstack sudo[89984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:55 devstack sudo[89984]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-941da42e-17d7-4e1e-b358-50f22888d2ca tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-8137c980-c699-45fa-9699-a6a7b30b1ae1" returned: 0 in 0.397s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:55 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-941da42e-17d7-4e1e-b358-50f22888d2ca tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "cinder-quobyte-8137c980-c699-45fa-9699-a6a7b30b1ae1" released by "delete_volume" :: held 0.919s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:49:55 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-941da42e-17d7-4e1e-b358-50f22888d2ca tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Created reservations ['1fde65e5-f7bd-4eaf-b76b-6cd29349a205', 'bb97d764-bd18-444f-bcae-23de0f09936c', '46118cda-3066-4245-8a57-8bd7fac96c92', 'c4f03cf2-9d00-4196-87b8-c450d06a0384'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:49:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-941da42e-17d7-4e1e-b358-50f22888d2ca tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-941da42e-17d7-4e1e-b358-50f22888d2ca tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:55 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-941da42e-17d7-4e1e-b358-50f22888d2ca tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:49:55 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-941da42e-17d7-4e1e-b358-50f22888d2ca tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:49:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-941da42e-17d7-4e1e-b358-50f22888d2ca tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-941da42e-17d7-4e1e-b358-50f22888d2ca tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:55 devstack sudo[89987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:49:55 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:55 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e3fbbd07-9afa-412c-bc95-6d0758bc95f3 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "cinder-a6cfa80e-206b-48a0-afe2-4d9ae3d82364-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:49:55 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e3fbbd07-9afa-412c-bc95-6d0758bc95f3 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "cinder-a6cfa80e-206b-48a0-afe2-4d9ae3d82364-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:49:55 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e3fbbd07-9afa-412c-bc95-6d0758bc95f3 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "cinder-quobyte-a6cfa80e-206b-48a0-afe2-4d9ae3d82364" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:49:55 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e3fbbd07-9afa-412c-bc95-6d0758bc95f3 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "cinder-quobyte-a6cfa80e-206b-48a0-afe2-4d9ae3d82364" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:49:55 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[079e905f-3ad2-416e-96fb-caf7d971a30c]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:49:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e3fbbd07-9afa-412c-bc95-6d0758bc95f3 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a6cfa80e-206b-48a0-afe2-4d9ae3d82364 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:55 devstack sudo[89989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a6cfa80e-206b-48a0-afe2-4d9ae3d82364 Apr 16 19:49:55 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:55 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-941da42e-17d7-4e1e-b358-50f22888d2ca tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.489s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:55 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-941da42e-17d7-4e1e-b358-50f22888d2ca tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:49:55 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-941da42e-17d7-4e1e-b358-50f22888d2ca tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Deleted volume successfully. Apr 16 19:49:55 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-941da42e-17d7-4e1e-b358-50f22888d2ca tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "cinder-8137c980-c699-45fa-9699-a6a7b30b1ae1-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:49:55 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e3fbbd07-9afa-412c-bc95-6d0758bc95f3 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a6cfa80e-206b-48a0-afe2-4d9ae3d82364" returned: 0 in 0.481s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e3fbbd07-9afa-412c-bc95-6d0758bc95f3 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a6cfa80e-206b-48a0-afe2-4d9ae3d82364 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:55 devstack sudo[89995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a6cfa80e-206b-48a0-afe2-4d9ae3d82364 Apr 16 19:49:55 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:56 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e3fbbd07-9afa-412c-bc95-6d0758bc95f3 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-a6cfa80e-206b-48a0-afe2-4d9ae3d82364" returned: 0 in 0.412s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:56 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e3fbbd07-9afa-412c-bc95-6d0758bc95f3 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "cinder-quobyte-a6cfa80e-206b-48a0-afe2-4d9ae3d82364" released by "delete_volume" :: held 0.917s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:49:56 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-e3fbbd07-9afa-412c-bc95-6d0758bc95f3 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Created reservations ['89a53317-ebb9-4089-9fab-398391626360', '74ae900d-79e0-411d-849c-1d1284ef8db9', 'b1fb55c4-e1e3-425a-83ea-6362596efdad', 'acd92d71-b0e0-43d6-a6e9-594447c00d53'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:49:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e3fbbd07-9afa-412c-bc95-6d0758bc95f3 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e3fbbd07-9afa-412c-bc95-6d0758bc95f3 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:56 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e3fbbd07-9afa-412c-bc95-6d0758bc95f3 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:49:56 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e3fbbd07-9afa-412c-bc95-6d0758bc95f3 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:49:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e3fbbd07-9afa-412c-bc95-6d0758bc95f3 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e3fbbd07-9afa-412c-bc95-6d0758bc95f3 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:56 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:49:56 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:56 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1c7e96d7-2db2-48fd-9c07-b772093bbcdf tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "cinder-e347dc9b-afe5-4d2d-a9a6-4814313adc3e-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:49:56 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1c7e96d7-2db2-48fd-9c07-b772093bbcdf tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "cinder-e347dc9b-afe5-4d2d-a9a6-4814313adc3e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:49:56 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1c7e96d7-2db2-48fd-9c07-b772093bbcdf tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "cinder-quobyte-e347dc9b-afe5-4d2d-a9a6-4814313adc3e" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:49:56 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1c7e96d7-2db2-48fd-9c07-b772093bbcdf tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "cinder-quobyte-e347dc9b-afe5-4d2d-a9a6-4814313adc3e" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:49:56 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddebc48b-2142-450f-a7e4-6d455ede8f26]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:49:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1c7e96d7-2db2-48fd-9c07-b772093bbcdf tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e347dc9b-afe5-4d2d-a9a6-4814313adc3e {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:56 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e347dc9b-afe5-4d2d-a9a6-4814313adc3e Apr 16 19:49:56 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:56 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e3fbbd07-9afa-412c-bc95-6d0758bc95f3 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.439s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:56 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-e3fbbd07-9afa-412c-bc95-6d0758bc95f3 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:49:56 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-e3fbbd07-9afa-412c-bc95-6d0758bc95f3 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Deleted volume successfully. Apr 16 19:49:56 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e3fbbd07-9afa-412c-bc95-6d0758bc95f3 tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "cinder-a6cfa80e-206b-48a0-afe2-4d9ae3d82364-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:49:56 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1c7e96d7-2db2-48fd-9c07-b772093bbcdf tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e347dc9b-afe5-4d2d-a9a6-4814313adc3e" returned: 0 in 0.488s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1c7e96d7-2db2-48fd-9c07-b772093bbcdf tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e347dc9b-afe5-4d2d-a9a6-4814313adc3e {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:56 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e347dc9b-afe5-4d2d-a9a6-4814313adc3e Apr 16 19:49:56 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:57 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1c7e96d7-2db2-48fd-9c07-b772093bbcdf tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e347dc9b-afe5-4d2d-a9a6-4814313adc3e" returned: 0 in 0.400s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1c7e96d7-2db2-48fd-9c07-b772093bbcdf tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "cinder-quobyte-e347dc9b-afe5-4d2d-a9a6-4814313adc3e" released by "delete_volume" :: held 0.911s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:49:57 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-1c7e96d7-2db2-48fd-9c07-b772093bbcdf tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Created reservations ['16fc413e-b819-418e-8e02-bace9b6424d4', '5d5150f1-d3e2-4039-bfde-689e30e9da1c', '413db1ab-17da-4583-a0b1-f01563b000c7', '661a5b3f-5289-48e8-81d9-2c795a50be13'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:49:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1c7e96d7-2db2-48fd-9c07-b772093bbcdf tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1c7e96d7-2db2-48fd-9c07-b772093bbcdf tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:57 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1c7e96d7-2db2-48fd-9c07-b772093bbcdf tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:49:57 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1c7e96d7-2db2-48fd-9c07-b772093bbcdf tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:49:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1c7e96d7-2db2-48fd-9c07-b772093bbcdf tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1c7e96d7-2db2-48fd-9c07-b772093bbcdf tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:57 devstack sudo[90009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:49:57 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-56e1ae5f-91e2-4d67-a9e2-2421f5549d4b tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "cinder-e51b5620-f399-445a-a5b4-69be150a0d75-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:49:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-56e1ae5f-91e2-4d67-a9e2-2421f5549d4b tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "cinder-e51b5620-f399-445a-a5b4-69be150a0d75-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:49:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-56e1ae5f-91e2-4d67-a9e2-2421f5549d4b tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "cinder-quobyte-e51b5620-f399-445a-a5b4-69be150a0d75" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:49:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-56e1ae5f-91e2-4d67-a9e2-2421f5549d4b tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "cinder-quobyte-e51b5620-f399-445a-a5b4-69be150a0d75" acquired by "delete_volume" :: waited 0.019s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:49:57 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee548e6-29a4-4a1a-bffa-bd8f5baae835]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:49:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-56e1ae5f-91e2-4d67-a9e2-2421f5549d4b tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e51b5620-f399-445a-a5b4-69be150a0d75 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:57 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e51b5620-f399-445a-a5b4-69be150a0d75 Apr 16 19:49:57 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:57 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1c7e96d7-2db2-48fd-9c07-b772093bbcdf tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.423s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:57 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-1c7e96d7-2db2-48fd-9c07-b772093bbcdf tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:49:57 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-1c7e96d7-2db2-48fd-9c07-b772093bbcdf tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Deleted volume successfully. Apr 16 19:49:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1c7e96d7-2db2-48fd-9c07-b772093bbcdf tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "cinder-e347dc9b-afe5-4d2d-a9a6-4814313adc3e-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:49:58 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-56e1ae5f-91e2-4d67-a9e2-2421f5549d4b tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e51b5620-f399-445a-a5b4-69be150a0d75" returned: 0 in 0.490s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-56e1ae5f-91e2-4d67-a9e2-2421f5549d4b tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e51b5620-f399-445a-a5b4-69be150a0d75 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:58 devstack sudo[90017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e51b5620-f399-445a-a5b4-69be150a0d75 Apr 16 19:49:58 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:58 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-56e1ae5f-91e2-4d67-a9e2-2421f5549d4b tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e51b5620-f399-445a-a5b4-69be150a0d75" returned: 0 in 0.516s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:58 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-56e1ae5f-91e2-4d67-a9e2-2421f5549d4b tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "cinder-quobyte-e51b5620-f399-445a-a5b4-69be150a0d75" released by "delete_volume" :: held 1.032s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:49:58 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-56e1ae5f-91e2-4d67-a9e2-2421f5549d4b tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Created reservations ['2278ef7f-628d-4f6e-b1dd-05334462f0c3', '7becb5fd-1b75-4f51-a6aa-e0b0d3a65181', '2a13eebc-4f24-4c61-96df-7d06fd1990dd', '2a3d1cae-3b9d-4e98-9cb0-99405796b56a'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:49:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-56e1ae5f-91e2-4d67-a9e2-2421f5549d4b tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:49:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-56e1ae5f-91e2-4d67-a9e2-2421f5549d4b tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:49:58 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-56e1ae5f-91e2-4d67-a9e2-2421f5549d4b tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:49:58 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-56e1ae5f-91e2-4d67-a9e2-2421f5549d4b tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:49:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-56e1ae5f-91e2-4d67-a9e2-2421f5549d4b tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:49:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-56e1ae5f-91e2-4d67-a9e2-2421f5549d4b tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:58 devstack sudo[90020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:49:58 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:49:59 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root Apr 16 19:49:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-56e1ae5f-91e2-4d67-a9e2-2421f5549d4b tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.427s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:49:59 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-56e1ae5f-91e2-4d67-a9e2-2421f5549d4b tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:49:59 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-56e1ae5f-91e2-4d67-a9e2-2421f5549d4b tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Deleted volume successfully. Apr 16 19:49:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-56e1ae5f-91e2-4d67-a9e2-2421f5549d4b tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "cinder-e51b5620-f399-445a-a5b4-69be150a0d75-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:49:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-948ca9f7-a71d-45a4-a8e1-304cf06b492c tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "cinder-d0520b46-c593-4c92-9640-a8c3d66075ec-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:49:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-948ca9f7-a71d-45a4-a8e1-304cf06b492c tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "cinder-d0520b46-c593-4c92-9640-a8c3d66075ec-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:49:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-948ca9f7-a71d-45a4-a8e1-304cf06b492c tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "cinder-quobyte-d0520b46-c593-4c92-9640-a8c3d66075ec" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:49:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-948ca9f7-a71d-45a4-a8e1-304cf06b492c tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "cinder-quobyte-d0520b46-c593-4c92-9640-a8c3d66075ec" acquired by "delete_volume" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:49:59 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca57b7c8-2980-4ad2-9b8e-7c87b164049c]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:49:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-948ca9f7-a71d-45a4-a8e1-304cf06b492c tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d0520b46-c593-4c92-9640-a8c3d66075ec {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:49:59 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d0520b46-c593-4c92-9640-a8c3d66075ec Apr 16 19:49:59 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:00 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-948ca9f7-a71d-45a4-a8e1-304cf06b492c tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d0520b46-c593-4c92-9640-a8c3d66075ec" returned: 0 in 0.496s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-948ca9f7-a71d-45a4-a8e1-304cf06b492c tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d0520b46-c593-4c92-9640-a8c3d66075ec {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:00 devstack sudo[90029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d0520b46-c593-4c92-9640-a8c3d66075ec Apr 16 19:50:00 devstack sudo[90029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:00 devstack sudo[90029]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-948ca9f7-a71d-45a4-a8e1-304cf06b492c tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d0520b46-c593-4c92-9640-a8c3d66075ec" returned: 0 in 0.422s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:00 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-948ca9f7-a71d-45a4-a8e1-304cf06b492c tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "cinder-quobyte-d0520b46-c593-4c92-9640-a8c3d66075ec" released by "delete_volume" :: held 0.941s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:00 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-948ca9f7-a71d-45a4-a8e1-304cf06b492c tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Created reservations ['32ba3f29-c0fa-43d5-85ec-cf11ee76bacc', 'b504dcf7-8d44-4fd0-83d3-4f33aa787cc0', '39d630f7-39cc-4632-a728-986424d462a4', '621b7a22-9c66-4e7c-b28b-116bdac8c9ea'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:50:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-948ca9f7-a71d-45a4-a8e1-304cf06b492c tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-948ca9f7-a71d-45a4-a8e1-304cf06b492c tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:00 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-948ca9f7-a71d-45a4-a8e1-304cf06b492c tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:00 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-948ca9f7-a71d-45a4-a8e1-304cf06b492c tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-948ca9f7-a71d-45a4-a8e1-304cf06b492c tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-948ca9f7-a71d-45a4-a8e1-304cf06b492c tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:00 devstack sudo[90032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:50:00 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:01 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-948ca9f7-a71d-45a4-a8e1-304cf06b492c tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.470s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:01 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-948ca9f7-a71d-45a4-a8e1-304cf06b492c tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:50:01 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-948ca9f7-a71d-45a4-a8e1-304cf06b492c tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Deleted volume successfully. Apr 16 19:50:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-948ca9f7-a71d-45a4-a8e1-304cf06b492c tempest-CreateVolumesFromSourceVolumeTest-1744759016 None] Lock "cinder-d0520b46-c593-4c92-9640-a8c3d66075ec-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:04 devstack cinder-volume[82569]: DEBUG oslo_service.periodic_task [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82569) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 19:50:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:04 devstack sudo[90063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:50:04 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:04 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.426s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:04 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Flow 'volume_create_manager' (b9ef51e9-f1c3-4b4d-9227-e788184652a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79393bcd-2ffc-4377-ad05-629d4df7df5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79393bcd-2ffc-4377-ad05-629d4df7df5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-7464867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ed6ca0-0994-4a62-8e3c-8227085faa7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55701d1c82e40a598769214a003be30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:08Z,use_quota=True,user_id='93e3aa68523b478e8228dc3dcaa7afcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (280ada67-b128-4268-b7fb-106b6bc4449a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (280ada67-b128-4268-b7fb-106b6bc4449a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (171cc3ae-7c3e-40f9-b0b3-79d25052f707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (171cc3ae-7c3e-40f9-b0b3-79d25052f707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56ed6ca0-0994-4a62-8e3c-8227085faa7c', 'volume_name': 'volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a954bd7d-8291-41fe-9ee8-20a104de2b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a954bd7d-8291-41fe-9ee8-20a104de2b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0f00b6-fb73-4f5c-8561-ff996191c081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:08 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Volume 56ed6ca0-0994-4a62-8e3c-8227085faa7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c', 'volume_size': 1} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-7464867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ed6ca0-0994-4a62-8e3c-8227085faa7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55701d1c82e40a598769214a003be30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:08Z,use_quota=True,user_id='93e3aa68523b478e8228dc3dcaa7afcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Creating volume 56ed6ca0-0994-4a62-8e3c-8227085faa7c {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:50:08 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:08 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c 1073741824 Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:50:08 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Flow 'volume_create_manager' (bccf4695-065d-42ca-ad30-17bba02bd381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f2ba9f5-8533-4d5e-9941-13f508a0aa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f2ba9f5-8533-4d5e-9941-13f508a0aa6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1166159807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1fd4245-bf40-4b45-8950-f912544d6476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da6f6ec936c4242a19df6c7defa991b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:08Z,use_quota=True,user_id='087003a4fa74437aa322011bd4270ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22fa5089-10e6-4209-b754-87cbe0402d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22fa5089-10e6-4209-b754-87cbe0402d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e1149a-b36b-467e-b7b6-edd253cd10ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e1149a-b36b-467e-b7b6-edd253cd10ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1fd4245-bf40-4b45-8950-f912544d6476', 'volume_name': 'volume-b1fd4245-bf40-4b45-8950-f912544d6476', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717fa0a8-a0d7-43b0-80cd-d164912bee4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717fa0a8-a0d7-43b0-80cd-d164912bee4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec61231-7151-422d-9bf3-d1f7685c364a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:08 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Volume b1fd4245-bf40-4b45-8950-f912544d6476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1fd4245-bf40-4b45-8950-f912544d6476', 'volume_size': 1} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Flow 'volume_create_manager' (80ccf2da-19f4-4668-a795-9f28a394f776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4ea293a-2861-4b03-9802-caabc7b62179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4ea293a-2861-4b03-9802-caabc7b62179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-620395863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a9cfdd6-f814-4287-aed0-f5f3e0dcd986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a97acd3df244290a11ff735ee8e60f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:09Z,use_quota=True,user_id='7fd3dc57181243c6a6d7f42b72ff9700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54cfa574-28ba-4879-94df-09b7f097b8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54cfa574-28ba-4879-94df-09b7f097b8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d549d821-ae45-450d-9768-369f6a96ea6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d549d821-ae45-450d-9768-369f6a96ea6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a9cfdd6-f814-4287-aed0-f5f3e0dcd986', 'volume_name': 'volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2923d03-3b22-4606-8f93-caa9d9f6363a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2923d03-3b22-4606-8f93-caa9d9f6363a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0591e9a-eec5-4de6-8e7b-7e91b9660c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:08 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Volume 0a9cfdd6-f814-4287-aed0-f5f3e0dcd986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986', 'volume_size': 1} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:50:08 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Flow 'volume_create_manager' (e62d360c-618e-41bd-845b-a9999d7c90e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7452ab6-807b-40d4-95d1-81e6218e6c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7452ab6-807b-40d4-95d1-81e6218e6c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-965876162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67cefc9f-2e85-45b8-8674-3045333669a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da6f6ec936c4242a19df6c7defa991b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:09Z,use_quota=True,user_id='087003a4fa74437aa322011bd4270ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (022f1d5c-48ae-4fd6-8636-a3f70ecf82d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (022f1d5c-48ae-4fd6-8636-a3f70ecf82d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d116782-aaaf-450a-88fe-cb0711d8c6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d116782-aaaf-450a-88fe-cb0711d8c6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67cefc9f-2e85-45b8-8674-3045333669a1', 'volume_name': 'volume-67cefc9f-2e85-45b8-8674-3045333669a1', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed83f5c-5d06-47e9-8bee-7d46b2a99b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed83f5c-5d06-47e9-8bee-7d46b2a99b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5030d19-9184-46b6-93e9-f8dcf77fe2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:09 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Volume 67cefc9f-2e85-45b8-8674-3045333669a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67cefc9f-2e85-45b8-8674-3045333669a1', 'volume_size': 1} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Flow 'volume_create_manager' (c9683012-2be8-46da-9e7f-faa5baeaf44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66aa2b86-6802-41ab-bf3b-bfddd24499c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66aa2b86-6802-41ab-bf3b-bfddd24499c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1166252294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e1c589-a38f-4df4-b8b0-d4be807b4b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da6f6ec936c4242a19df6c7defa991b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:09Z,use_quota=True,user_id='087003a4fa74437aa322011bd4270ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca31653d-8c0a-41eb-a070-c01596c89a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca31653d-8c0a-41eb-a070-c01596c89a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e662b3b3-cd5d-4ab0-a0c0-6926d82b0630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e662b3b3-cd5d-4ab0-a0c0-6926d82b0630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9e1c589-a38f-4df4-b8b0-d4be807b4b69', 'volume_name': 'volume-f9e1c589-a38f-4df4-b8b0-d4be807b4b69', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28e78b5-ed91-460f-9859-c2d6a115d8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28e78b5-ed91-460f-9859-c2d6a115d8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b89806-89aa-4d9f-a8be-a34e553709f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:09 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Volume f9e1c589-a38f-4df4-b8b0-d4be807b4b69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9e1c589-a38f-4df4-b8b0-d4be807b4b69', 'volume_size': 1} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Flow 'volume_create_manager' (c0d02be2-72bd-4e90-8484-1378c48e1998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3dd01ed-2526-4838-819b-72bdd5300dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3dd01ed-2526-4838-819b-72bdd5300dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1509787735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d5b09d7-7cbf-487d-813a-2a7c93d3ea18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da6f6ec936c4242a19df6c7defa991b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:09Z,use_quota=True,user_id='087003a4fa74437aa322011bd4270ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (083c6e36-c476-49cc-963c-27564c74a659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (083c6e36-c476-49cc-963c-27564c74a659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9ce2d0-142f-4409-a471-32b53136a4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9ce2d0-142f-4409-a471-32b53136a4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d5b09d7-7cbf-487d-813a-2a7c93d3ea18', 'volume_name': 'volume-7d5b09d7-7cbf-487d-813a-2a7c93d3ea18', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f273b9-95f5-4e38-9d4c-b7252a705047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f273b9-95f5-4e38-9d4c-b7252a705047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:09 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22497af7-ee1b-4073-ab5a-34130420563a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:09 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Volume 7d5b09d7-7cbf-487d-813a-2a7c93d3ea18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d5b09d7-7cbf-487d-813a-2a7c93d3ea18', 'volume_size': 1} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c 1073741824" returned: 0 in 0.834s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:09 devstack sudo[90088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c Apr 16 19:50:09 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Flow 'volume_create_manager' (030fadb1-b305-4408-809e-2dc872bb5598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec1db88-da82-460f-b88b-3dc56d548a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec1db88-da82-460f-b88b-3dc56d548a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1591636631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e8220b-a0d3-4b47-ac4b-0cc0e0936086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da6f6ec936c4242a19df6c7defa991b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:10Z,use_quota=True,user_id='087003a4fa74437aa322011bd4270ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95d9182-d36a-4668-8cfb-b5686b065517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95d9182-d36a-4668-8cfb-b5686b065517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e331373f-37bd-4f7c-8115-9784a4c33ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e331373f-37bd-4f7c-8115-9784a4c33ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39e8220b-a0d3-4b47-ac4b-0cc0e0936086', 'volume_name': 'volume-39e8220b-a0d3-4b47-ac4b-0cc0e0936086', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57c5e32-3ff7-4f05-a3b5-42191e4674b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57c5e32-3ff7-4f05-a3b5-42191e4674b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8dce02-a188-4f58-bf3a-d9edc26774bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:09 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Volume 39e8220b-a0d3-4b47-ac4b-0cc0e0936086: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39e8220b-a0d3-4b47-ac4b-0cc0e0936086', 'volume_size': 1} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:09 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c" returned: 0 in 0.518s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.217s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1166159807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1fd4245-bf40-4b45-8950-f912544d6476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da6f6ec936c4242a19df6c7defa991b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:08Z,use_quota=True,user_id='087003a4fa74437aa322011bd4270ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Creating volume b1fd4245-bf40-4b45-8950-f912544d6476 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:50:09 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b1fd4245-bf40-4b45-8950-f912544d6476 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0f00b6-fb73-4f5c-8561-ff996191c081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:09 devstack sudo[90093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b1fd4245-bf40-4b45-8950-f912544d6476 1073741824 Apr 16 19:50:09 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:09 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7733a6ee-000b-457d-9e4d-6800d73aba41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:10 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Volume volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c (56ed6ca0-0994-4a62-8e3c-8227085faa7c): created successfully Apr 16 19:50:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7733a6ee-000b-457d-9e4d-6800d73aba41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:10 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Flow 'volume_create_manager' (b9ef51e9-f1c3-4b4d-9227-e788184652a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:10 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-7d959137-9007-4434-b411-aad97c7399bf tempest-VolumeDependencyTests-669614506 None] Created volume successfully. Apr 16 19:50:10 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b1fd4245-bf40-4b45-8950-f912544d6476 1073741824" returned: 0 in 0.537s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b1fd4245-bf40-4b45-8950-f912544d6476 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:10 devstack sudo[90098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b1fd4245-bf40-4b45-8950-f912544d6476 Apr 16 19:50:10 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1d842491-617f-4b4a-b6b4-ad3215a00245 tempest-VolumeDependencyTests-669614506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:11 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b1fd4245-bf40-4b45-8950-f912544d6476" returned: 0 in 0.480s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:11 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:50:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.057s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:11 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-620395863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a9cfdd6-f814-4287-aed0-f5f3e0dcd986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a97acd3df244290a11ff735ee8e60f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:09Z,use_quota=True,user_id='7fd3dc57181243c6a6d7f42b72ff9700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:50:11 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Creating volume 0a9cfdd6-f814-4287-aed0-f5f3e0dcd986 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:50:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:11 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:11 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:11 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:50:11 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:50:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:11 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec61231-7151-422d-9bf3-d1f7685c364a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1fd4245-bf40-4b45-8950-f912544d6476', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:11 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b0b4502-9b48-4d13-b509-13c9b5f78440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:11 devstack sudo[90101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986 1073741824 Apr 16 19:50:11 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:11 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Volume volume-b1fd4245-bf40-4b45-8950-f912544d6476 (b1fd4245-bf40-4b45-8950-f912544d6476): created successfully Apr 16 19:50:11 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b0b4502-9b48-4d13-b509-13c9b5f78440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:11 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Flow 'volume_create_manager' (bccf4695-065d-42ca-ad30-17bba02bd381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:11 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-504702a9-5948-40e8-950b-439474ff4995 tempest-CreateVolumesFromImageTest-1473269475 None] Created volume successfully. Apr 16 19:50:11 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986 1073741824" returned: 0 in 0.544s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:11 devstack sudo[90106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986 Apr 16 19:50:11 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:12 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986" returned: 0 in 0.534s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:12 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:50:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.055s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:12 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-965876162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67cefc9f-2e85-45b8-8674-3045333669a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da6f6ec936c4242a19df6c7defa991b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:09Z,use_quota=True,user_id='087003a4fa74437aa322011bd4270ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:50:12 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Creating volume 67cefc9f-2e85-45b8-8674-3045333669a1 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:50:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:12 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:12 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:12 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:50:12 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:50:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-67cefc9f-2e85-45b8-8674-3045333669a1 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:12 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0591e9a-eec5-4de6-8e7b-7e91b9660c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:12 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c2e51c-48eb-4e0a-9541-ba1d65f26393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:12 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-67cefc9f-2e85-45b8-8674-3045333669a1 1073741824 Apr 16 19:50:12 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:12 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Volume volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986 (0a9cfdd6-f814-4287-aed0-f5f3e0dcd986): created successfully Apr 16 19:50:12 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c2e51c-48eb-4e0a-9541-ba1d65f26393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:12 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Flow 'volume_create_manager' (80ccf2da-19f4-4668-a795-9f28a394f776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:12 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-57d8c21e-e0dc-4c88-b59d-2714ce3b3268 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Created volume successfully. Apr 16 19:50:12 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-67cefc9f-2e85-45b8-8674-3045333669a1 1073741824" returned: 0 in 0.561s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-67cefc9f-2e85-45b8-8674-3045333669a1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:12 devstack sudo[90148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-67cefc9f-2e85-45b8-8674-3045333669a1 Apr 16 19:50:12 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b9dd1ff6-8e2a-4d4d-940b-e06ef108c0ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:13 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-67cefc9f-2e85-45b8-8674-3045333669a1" returned: 0 in 0.511s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:13 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:50:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.061s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:13 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1166252294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e1c589-a38f-4df4-b8b0-d4be807b4b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da6f6ec936c4242a19df6c7defa991b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:09Z,use_quota=True,user_id='087003a4fa74437aa322011bd4270ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:50:13 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Creating volume f9e1c589-a38f-4df4-b8b0-d4be807b4b69 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:50:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:13 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:13 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:13 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:50:13 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:50:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f9e1c589-a38f-4df4-b8b0-d4be807b4b69 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5030d19-9184-46b6-93e9-f8dcf77fe2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67cefc9f-2e85-45b8-8674-3045333669a1', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:13 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f9e1c589-a38f-4df4-b8b0-d4be807b4b69 1073741824 Apr 16 19:50:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc00852-17fe-43c1-a019-b4fcb843decc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:13 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:13 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Volume volume-67cefc9f-2e85-45b8-8674-3045333669a1 (67cefc9f-2e85-45b8-8674-3045333669a1): created successfully Apr 16 19:50:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc00852-17fe-43c1-a019-b4fcb843decc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:13 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Flow 'volume_create_manager' (e62d360c-618e-41bd-845b-a9999d7c90e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:13 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-f4926b15-3382-4201-a461-c0f89e4a34ab tempest-CreateVolumesFromImageTest-1473269475 None] Created volume successfully. Apr 16 19:50:13 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f9e1c589-a38f-4df4-b8b0-d4be807b4b69 1073741824" returned: 0 in 0.601s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f9e1c589-a38f-4df4-b8b0-d4be807b4b69 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:13 devstack sudo[90157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f9e1c589-a38f-4df4-b8b0-d4be807b4b69 Apr 16 19:50:13 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:14 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f9e1c589-a38f-4df4-b8b0-d4be807b4b69" returned: 0 in 0.502s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:50:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.987s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1509787735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d5b09d7-7cbf-487d-813a-2a7c93d3ea18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da6f6ec936c4242a19df6c7defa991b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:09Z,use_quota=True,user_id='087003a4fa74437aa322011bd4270ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:50:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Creating volume 7d5b09d7-7cbf-487d-813a-2a7c93d3ea18 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:50:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:14 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:50:14 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:50:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7d5b09d7-7cbf-487d-813a-2a7c93d3ea18 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b89806-89aa-4d9f-a8be-a34e553709f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9e1c589-a38f-4df4-b8b0-d4be807b4b69', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50ca1e7-90bb-4e4e-b28f-ad1556491be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:14 devstack sudo[90160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7d5b09d7-7cbf-487d-813a-2a7c93d3ea18 1073741824 Apr 16 19:50:14 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:14 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Volume volume-f9e1c589-a38f-4df4-b8b0-d4be807b4b69 (f9e1c589-a38f-4df4-b8b0-d4be807b4b69): created successfully Apr 16 19:50:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50ca1e7-90bb-4e4e-b28f-ad1556491be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:14 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Flow 'volume_create_manager' (c9683012-2be8-46da-9e7f-faa5baeaf44f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:14 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-78fadd93-de71-475f-9a71-dc8868d5d00a tempest-CreateVolumesFromImageTest-1473269475 None] Created volume successfully. Apr 16 19:50:14 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:14 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7d5b09d7-7cbf-487d-813a-2a7c93d3ea18 1073741824" returned: 0 in 0.600s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7d5b09d7-7cbf-487d-813a-2a7c93d3ea18 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:15 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7d5b09d7-7cbf-487d-813a-2a7c93d3ea18 Apr 16 19:50:15 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:15 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7d5b09d7-7cbf-487d-813a-2a7c93d3ea18" returned: 0 in 0.533s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:15 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:50:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.873s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:15 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1591636631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e8220b-a0d3-4b47-ac4b-0cc0e0936086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da6f6ec936c4242a19df6c7defa991b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:10Z,use_quota=True,user_id='087003a4fa74437aa322011bd4270ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:50:15 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Creating volume 39e8220b-a0d3-4b47-ac4b-0cc0e0936086 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:50:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:15 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:15 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:15 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:50:15 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:50:15 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-39e8220b-a0d3-4b47-ac4b-0cc0e0936086 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:15 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22497af7-ee1b-4073-ab5a-34130420563a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d5b09d7-7cbf-487d-813a-2a7c93d3ea18', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:15 devstack sudo[90168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-39e8220b-a0d3-4b47-ac4b-0cc0e0936086 1073741824 Apr 16 19:50:15 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:15 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af31d220-d850-494e-8272-9687163770b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:15 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Volume volume-7d5b09d7-7cbf-487d-813a-2a7c93d3ea18 (7d5b09d7-7cbf-487d-813a-2a7c93d3ea18): created successfully Apr 16 19:50:15 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af31d220-d850-494e-8272-9687163770b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:15 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Flow 'volume_create_manager' (c0d02be2-72bd-4e90-8484-1378c48e1998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:15 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-89c7c766-0bf9-416a-a3ba-5ec6c015a162 tempest-CreateVolumesFromImageTest-1473269475 None] Created volume successfully. Apr 16 19:50:16 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-39e8220b-a0d3-4b47-ac4b-0cc0e0936086 1073741824" returned: 0 in 0.661s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-39e8220b-a0d3-4b47-ac4b-0cc0e0936086 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:16 devstack sudo[90174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-39e8220b-a0d3-4b47-ac4b-0cc0e0936086 Apr 16 19:50:16 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:16 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-39e8220b-a0d3-4b47-ac4b-0cc0e0936086" returned: 0 in 0.496s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:16 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:50:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1d842491-617f-4b4a-b6b4-ad3215a00245 tempest-VolumeDependencyTests-669614506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.030s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:16 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8dce02-a188-4f58-bf3a-d9edc26774bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39e8220b-a0d3-4b47-ac4b-0cc0e0936086', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:16 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7c2a708-f0da-45c3-8a43-1f8832135cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:16 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-1d842491-617f-4b4a-b6b4-ad3215a00245 tempest-VolumeDependencyTests-669614506 None] Creating offline snapshot 10e48bc3-48dd-43ad-8a83-dbd42b6b341f of volume 56ed6ca0-0994-4a62-8e3c-8227085faa7c {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:50:16 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Volume volume-39e8220b-a0d3-4b47-ac4b-0cc0e0936086 (39e8220b-a0d3-4b47-ac4b-0cc0e0936086): created successfully Apr 16 19:50:16 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7c2a708-f0da-45c3-8a43-1f8832135cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:16 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Flow 'volume_create_manager' (030fadb1-b305-4408-809e-2dc872bb5598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:16 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00e77ef-ad92-428a-bfd3-4bb535213b83]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:16 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1d842491-617f-4b4a-b6b4-ad3215a00245 tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:16 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-7c81fb6f-13e6-4209-9397-8a47c80bc891 tempest-CreateVolumesFromImageTest-1473269475 None] Created volume successfully. Apr 16 19:50:16 devstack sudo[90177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c Apr 16 19:50:16 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:17 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b2aabde7-e23b-4d17-942f-0f65c3b6a8c7 tempest-CreateVolumesFromImageTest-1473269475 None] Acquiring lock "cinder-39e8220b-a0d3-4b47-ac4b-0cc0e0936086-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:17 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b2aabde7-e23b-4d17-942f-0f65c3b6a8c7 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "cinder-39e8220b-a0d3-4b47-ac4b-0cc0e0936086-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:17 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b2aabde7-e23b-4d17-942f-0f65c3b6a8c7 tempest-CreateVolumesFromImageTest-1473269475 None] Acquiring lock "cinder-quobyte-39e8220b-a0d3-4b47-ac4b-0cc0e0936086" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:17 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b2aabde7-e23b-4d17-942f-0f65c3b6a8c7 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "cinder-quobyte-39e8220b-a0d3-4b47-ac4b-0cc0e0936086" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:17 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[0988d5d4-9d79-40a4-8500-e53be09b70a6]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b2aabde7-e23b-4d17-942f-0f65c3b6a8c7 tempest-CreateVolumesFromImageTest-1473269475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-39e8220b-a0d3-4b47-ac4b-0cc0e0936086 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:17 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1d842491-617f-4b4a-b6b4-ad3215a00245 tempest-VolumeDependencyTests-669614506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c" returned: 0 in 0.617s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1d842491-617f-4b4a-b6b4-ad3215a00245 tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.10e48bc3-48dd-43ad-8a83-dbd42b6b341f 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:17 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-39e8220b-a0d3-4b47-ac4b-0cc0e0936086 Apr 16 19:50:17 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:17 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.10e48bc3-48dd-43ad-8a83-dbd42b6b341f 1G Apr 16 19:50:17 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:17 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b2aabde7-e23b-4d17-942f-0f65c3b6a8c7 tempest-CreateVolumesFromImageTest-1473269475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-39e8220b-a0d3-4b47-ac4b-0cc0e0936086" returned: 0 in 0.578s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:17 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b2aabde7-e23b-4d17-942f-0f65c3b6a8c7 tempest-CreateVolumesFromImageTest-1473269475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-39e8220b-a0d3-4b47-ac4b-0cc0e0936086 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:17 devstack sudo[90192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-39e8220b-a0d3-4b47-ac4b-0cc0e0936086 Apr 16 19:50:17 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:18 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1d842491-617f-4b4a-b6b4-ad3215a00245 tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.10e48bc3-48dd-43ad-8a83-dbd42b6b341f 1G" returned: 0 in 0.636s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1d842491-617f-4b4a-b6b4-ad3215a00245 tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.10e48bc3-48dd-43ad-8a83-dbd42b6b341f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:18 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.10e48bc3-48dd-43ad-8a83-dbd42b6b341f Apr 16 19:50:18 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:18 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b2aabde7-e23b-4d17-942f-0f65c3b6a8c7 tempest-CreateVolumesFromImageTest-1473269475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-39e8220b-a0d3-4b47-ac4b-0cc0e0936086" returned: 0 in 0.515s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:18 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b2aabde7-e23b-4d17-942f-0f65c3b6a8c7 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "cinder-quobyte-39e8220b-a0d3-4b47-ac4b-0cc0e0936086" released by "delete_volume" :: held 1.131s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:18 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-b2aabde7-e23b-4d17-942f-0f65c3b6a8c7 tempest-CreateVolumesFromImageTest-1473269475 None] Created reservations ['e569c2b7-bd62-4393-a037-cca7c704d195', '2b205b12-9d7d-4e2d-8745-56ccd5580210', '8ebc0745-0fac-4c26-ac6b-ff76646d720f', 'b56ff000-e654-4580-b5da-874045682e12'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:50:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b2aabde7-e23b-4d17-942f-0f65c3b6a8c7 tempest-CreateVolumesFromImageTest-1473269475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b2aabde7-e23b-4d17-942f-0f65c3b6a8c7 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:18 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-b2aabde7-e23b-4d17-942f-0f65c3b6a8c7 tempest-CreateVolumesFromImageTest-1473269475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:18 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-b2aabde7-e23b-4d17-942f-0f65c3b6a8c7 tempest-CreateVolumesFromImageTest-1473269475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b2aabde7-e23b-4d17-942f-0f65c3b6a8c7 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b2aabde7-e23b-4d17-942f-0f65c3b6a8c7 tempest-CreateVolumesFromImageTest-1473269475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:18 devstack sudo[90200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:50:18 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:18 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1d842491-617f-4b4a-b6b4-ad3215a00245 tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.10e48bc3-48dd-43ad-8a83-dbd42b6b341f" returned: 0 in 0.533s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:18 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-1d842491-617f-4b4a-b6b4-ad3215a00245 tempest-VolumeDependencyTests-669614506 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.10e48bc3-48dd-43ad-8a83-dbd42b6b341f is being set with open permissions: ugo+rw Apr 16 19:50:18 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1d842491-617f-4b4a-b6b4-ad3215a00245 tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.10e48bc3-48dd-43ad-8a83-dbd42b6b341f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:18 devstack sudo[90202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.10e48bc3-48dd-43ad-8a83-dbd42b6b341f Apr 16 19:50:18 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:19 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b2aabde7-e23b-4d17-942f-0f65c3b6a8c7 tempest-CreateVolumesFromImageTest-1473269475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.480s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:19 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-b2aabde7-e23b-4d17-942f-0f65c3b6a8c7 tempest-CreateVolumesFromImageTest-1473269475 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:50:19 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-b2aabde7-e23b-4d17-942f-0f65c3b6a8c7 tempest-CreateVolumesFromImageTest-1473269475 None] Deleted volume successfully. Apr 16 19:50:19 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b2aabde7-e23b-4d17-942f-0f65c3b6a8c7 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "cinder-39e8220b-a0d3-4b47-ac4b-0cc0e0936086-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:19 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1d842491-617f-4b4a-b6b4-ad3215a00245 tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.10e48bc3-48dd-43ad-8a83-dbd42b6b341f" returned: 0 in 0.491s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1d842491-617f-4b4a-b6b4-ad3215a00245 tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:19 devstack sudo[90206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.info Apr 16 19:50:19 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:19 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ef554df2-eab8-4f6e-a519-7afde65e9d67 tempest-CreateVolumesFromImageTest-1473269475 None] Acquiring lock "cinder-7d5b09d7-7cbf-487d-813a-2a7c93d3ea18-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:19 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ef554df2-eab8-4f6e-a519-7afde65e9d67 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "cinder-7d5b09d7-7cbf-487d-813a-2a7c93d3ea18-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:19 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ef554df2-eab8-4f6e-a519-7afde65e9d67 tempest-CreateVolumesFromImageTest-1473269475 None] Acquiring lock "cinder-quobyte-7d5b09d7-7cbf-487d-813a-2a7c93d3ea18" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:19 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ef554df2-eab8-4f6e-a519-7afde65e9d67 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "cinder-quobyte-7d5b09d7-7cbf-487d-813a-2a7c93d3ea18" acquired by "delete_volume" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:19 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab18a23-cd31-4bc0-b843-be34844f40b1]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ef554df2-eab8-4f6e-a519-7afde65e9d67 tempest-CreateVolumesFromImageTest-1473269475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7d5b09d7-7cbf-487d-813a-2a7c93d3ea18 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:19 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1d842491-617f-4b4a-b6b4-ad3215a00245 tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.info" returned: 0 in 0.471s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:19 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-1d842491-617f-4b4a-b6b4-ad3215a00245 tempest-VolumeDependencyTests-669614506 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.info is being set with open permissions: ugo+rw Apr 16 19:50:19 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1d842491-617f-4b4a-b6b4-ad3215a00245 tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:19 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.info Apr 16 19:50:19 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:19 devstack sudo[90209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7d5b09d7-7cbf-487d-813a-2a7c93d3ea18 Apr 16 19:50:19 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:20 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1d842491-617f-4b4a-b6b4-ad3215a00245 tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.info" returned: 0 in 0.485s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1d842491-617f-4b4a-b6b4-ad3215a00245 tempest-VolumeDependencyTests-669614506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.313s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b9dd1ff6-8e2a-4d4d-940b-e06ef108c0ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.898s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:20 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-b9dd1ff6-8e2a-4d4d-940b-e06ef108c0ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Creating offline snapshot 8bce2df8-6da9-461a-9ed6-204b2745e657 of volume 0a9cfdd6-f814-4287-aed0-f5f3e0dcd986 {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:50:20 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-1d842491-617f-4b4a-b6b4-ad3215a00245 tempest-VolumeDependencyTests-669614506 None] Create snapshot completed successfully Apr 16 19:50:20 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1ce200-2321-4b7a-898d-5d6d2538892b]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b9dd1ff6-8e2a-4d4d-940b-e06ef108c0ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:20 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ef554df2-eab8-4f6e-a519-7afde65e9d67 tempest-CreateVolumesFromImageTest-1473269475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7d5b09d7-7cbf-487d-813a-2a7c93d3ea18" returned: 0 in 0.608s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ef554df2-eab8-4f6e-a519-7afde65e9d67 tempest-CreateVolumesFromImageTest-1473269475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7d5b09d7-7cbf-487d-813a-2a7c93d3ea18 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:20 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986 Apr 16 19:50:20 devstack sudo[90218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7d5b09d7-7cbf-487d-813a-2a7c93d3ea18 Apr 16 19:50:20 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:20 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:20 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b9dd1ff6-8e2a-4d4d-940b-e06ef108c0ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986" returned: 0 in 0.582s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b9dd1ff6-8e2a-4d4d-940b-e06ef108c0ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986.8bce2df8-6da9-461a-9ed6-204b2745e657 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:20 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986.8bce2df8-6da9-461a-9ed6-204b2745e657 1G Apr 16 19:50:20 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:20 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ef554df2-eab8-4f6e-a519-7afde65e9d67 tempest-CreateVolumesFromImageTest-1473269475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-7d5b09d7-7cbf-487d-813a-2a7c93d3ea18" returned: 0 in 0.556s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:20 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ef554df2-eab8-4f6e-a519-7afde65e9d67 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "cinder-quobyte-7d5b09d7-7cbf-487d-813a-2a7c93d3ea18" released by "delete_volume" :: held 1.189s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:20 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-ef554df2-eab8-4f6e-a519-7afde65e9d67 tempest-CreateVolumesFromImageTest-1473269475 None] Created reservations ['9eb0c219-4ec5-41d9-8bc4-668d0743f4d1', 'f0ac93d5-d18d-4b2b-8411-ea11b309beec', 'c91bc429-ca31-4af5-b9a8-65444bf2ca42', '962880a9-9857-4159-8cd3-f379135c42d1'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:50:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ef554df2-eab8-4f6e-a519-7afde65e9d67 tempest-CreateVolumesFromImageTest-1473269475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ef554df2-eab8-4f6e-a519-7afde65e9d67 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:20 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ef554df2-eab8-4f6e-a519-7afde65e9d67 tempest-CreateVolumesFromImageTest-1473269475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:20 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ef554df2-eab8-4f6e-a519-7afde65e9d67 tempest-CreateVolumesFromImageTest-1473269475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ef554df2-eab8-4f6e-a519-7afde65e9d67 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:20 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ef554df2-eab8-4f6e-a519-7afde65e9d67 tempest-CreateVolumesFromImageTest-1473269475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:20 devstack sudo[90227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:50:20 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:21 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ef554df2-eab8-4f6e-a519-7afde65e9d67 tempest-CreateVolumesFromImageTest-1473269475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.504s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:21 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-ef554df2-eab8-4f6e-a519-7afde65e9d67 tempest-CreateVolumesFromImageTest-1473269475 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:50:21 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-ef554df2-eab8-4f6e-a519-7afde65e9d67 tempest-CreateVolumesFromImageTest-1473269475 None] Deleted volume successfully. Apr 16 19:50:21 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b9dd1ff6-8e2a-4d4d-940b-e06ef108c0ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986.8bce2df8-6da9-461a-9ed6-204b2745e657 1G" returned: 0 in 0.663s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b9dd1ff6-8e2a-4d4d-940b-e06ef108c0ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986.8bce2df8-6da9-461a-9ed6-204b2745e657 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:21 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ef554df2-eab8-4f6e-a519-7afde65e9d67 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "cinder-7d5b09d7-7cbf-487d-813a-2a7c93d3ea18-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:21 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986.8bce2df8-6da9-461a-9ed6-204b2745e657 Apr 16 19:50:21 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:21 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:50:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Flow 'volume_create_manager' (257b8ba2-805e-4c16-9556-b5246cf7616e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce2ed17-dd59-4a7b-b7e9-daf63e8971dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce2ed17-dd59-4a7b-b7e9-daf63e8971dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-56857652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c467ea55-e362-4765-8729-64c350538b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55701d1c82e40a598769214a003be30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=10e48bc3-48dd-43ad-8a83-dbd42b6b341f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:21Z,use_quota=True,user_id='93e3aa68523b478e8228dc3dcaa7afcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e40a2e-fddf-4e2a-9402-a1a83247ee6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e40a2e-fddf-4e2a-9402-a1a83247ee6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f897d8be-4a13-4b70-b2ad-7423672bf0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f897d8be-4a13-4b70-b2ad-7423672bf0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c467ea55-e362-4765-8729-64c350538b8a', 'volume_name': 'volume-c467ea55-e362-4765-8729-64c350538b8a', 'volume_size': 1, 'snapshot_id': '10e48bc3-48dd-43ad-8a83-dbd42b6b341f'}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70ec585-515f-463b-88cc-f105b132c4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70ec585-515f-463b-88cc-f105b132c4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:21 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f391d08-ad20-4082-a735-eea0d6d9eea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:21 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Volume c467ea55-e362-4765-8729-64c350538b8a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c467ea55-e362-4765-8729-64c350538b8a', 'volume_size': 1, 'snapshot_id': '10e48bc3-48dd-43ad-8a83-dbd42b6b341f'} Apr 16 19:50:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:21 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1a34de53-fd13-4152-b544-4c95858e0f28 tempest-CreateVolumesFromImageTest-1473269475 None] Acquiring lock "cinder-f9e1c589-a38f-4df4-b8b0-d4be807b4b69-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:21 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1a34de53-fd13-4152-b544-4c95858e0f28 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "cinder-f9e1c589-a38f-4df4-b8b0-d4be807b4b69-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:21 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1a34de53-fd13-4152-b544-4c95858e0f28 tempest-CreateVolumesFromImageTest-1473269475 None] Acquiring lock "cinder-quobyte-f9e1c589-a38f-4df4-b8b0-d4be807b4b69" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:21 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1a34de53-fd13-4152-b544-4c95858e0f28 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "cinder-quobyte-f9e1c589-a38f-4df4-b8b0-d4be807b4b69" acquired by "delete_volume" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:21 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a526c24-5f85-4df8-a070-38745762c37d]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:21 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1a34de53-fd13-4152-b544-4c95858e0f28 tempest-CreateVolumesFromImageTest-1473269475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f9e1c589-a38f-4df4-b8b0-d4be807b4b69 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:21 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f9e1c589-a38f-4df4-b8b0-d4be807b4b69 Apr 16 19:50:21 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:22 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b9dd1ff6-8e2a-4d4d-940b-e06ef108c0ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986.8bce2df8-6da9-461a-9ed6-204b2745e657" returned: 0 in 0.692s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:22 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-b9dd1ff6-8e2a-4d4d-940b-e06ef108c0ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986.8bce2df8-6da9-461a-9ed6-204b2745e657 is being set with open permissions: ugo+rw Apr 16 19:50:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b9dd1ff6-8e2a-4d4d-940b-e06ef108c0ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986.8bce2df8-6da9-461a-9ed6-204b2745e657 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:22 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986.8bce2df8-6da9-461a-9ed6-204b2745e657 Apr 16 19:50:22 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:22 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1a34de53-fd13-4152-b544-4c95858e0f28 tempest-CreateVolumesFromImageTest-1473269475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f9e1c589-a38f-4df4-b8b0-d4be807b4b69" returned: 0 in 0.808s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1a34de53-fd13-4152-b544-4c95858e0f28 tempest-CreateVolumesFromImageTest-1473269475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f9e1c589-a38f-4df4-b8b0-d4be807b4b69 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:22 devstack sudo[90246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f9e1c589-a38f-4df4-b8b0-d4be807b4b69 Apr 16 19:50:22 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:22 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b9dd1ff6-8e2a-4d4d-940b-e06ef108c0ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986.8bce2df8-6da9-461a-9ed6-204b2745e657" returned: 0 in 0.589s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:22 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b9dd1ff6-8e2a-4d4d-940b-e06ef108c0ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:22 devstack sudo[90248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986.info Apr 16 19:50:22 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:23 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1a34de53-fd13-4152-b544-4c95858e0f28 tempest-CreateVolumesFromImageTest-1473269475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f9e1c589-a38f-4df4-b8b0-d4be807b4b69" returned: 0 in 0.508s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1a34de53-fd13-4152-b544-4c95858e0f28 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "cinder-quobyte-f9e1c589-a38f-4df4-b8b0-d4be807b4b69" released by "delete_volume" :: held 1.344s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-1a34de53-fd13-4152-b544-4c95858e0f28 tempest-CreateVolumesFromImageTest-1473269475 None] Created reservations ['7bb32049-adaf-429f-bab0-8fbd55546b08', 'e467c4c1-47ef-4c97-a902-6e7425398c50', '5d49708e-b495-41d3-b34f-adf3f624779a', 'f2a12497-0046-4404-99eb-fa9b36088851'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1a34de53-fd13-4152-b544-4c95858e0f28 tempest-CreateVolumesFromImageTest-1473269475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1a34de53-fd13-4152-b544-4c95858e0f28 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1a34de53-fd13-4152-b544-4c95858e0f28 tempest-CreateVolumesFromImageTest-1473269475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:23 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1a34de53-fd13-4152-b544-4c95858e0f28 tempest-CreateVolumesFromImageTest-1473269475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1a34de53-fd13-4152-b544-4c95858e0f28 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1a34de53-fd13-4152-b544-4c95858e0f28 tempest-CreateVolumesFromImageTest-1473269475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b9dd1ff6-8e2a-4d4d-940b-e06ef108c0ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986.info" returned: 0 in 0.496s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:23 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-b9dd1ff6-8e2a-4d4d-940b-e06ef108c0ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986.info is being set with open permissions: ugo+rw Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b9dd1ff6-8e2a-4d4d-940b-e06ef108c0ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:23 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:50:23 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:23 devstack sudo[90253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986.info Apr 16 19:50:23 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:23 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1a34de53-fd13-4152-b544-4c95858e0f28 tempest-CreateVolumesFromImageTest-1473269475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.506s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-1a34de53-fd13-4152-b544-4c95858e0f28 tempest-CreateVolumesFromImageTest-1473269475 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:50:23 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-1a34de53-fd13-4152-b544-4c95858e0f28 tempest-CreateVolumesFromImageTest-1473269475 None] Deleted volume successfully. Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-1a34de53-fd13-4152-b544-4c95858e0f28 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "cinder-f9e1c589-a38f-4df4-b8b0-d4be807b4b69-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:23 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b9dd1ff6-8e2a-4d4d-940b-e06ef108c0ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986.info" returned: 0 in 0.521s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b9dd1ff6-8e2a-4d4d-940b-e06ef108c0ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.623s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.136s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Acquiring lock "cinder-quobyte-10e48bc3-48dd-43ad-8a83-dbd42b6b341f-c467ea55-e362-4765-8729-64c350538b8a" by "_create_volume_from_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:23 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-b9dd1ff6-8e2a-4d4d-940b-e06ef108c0ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Create snapshot completed successfully Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Lock "cinder-quobyte-10e48bc3-48dd-43ad-8a83-dbd42b6b341f-c467ea55-e362-4765-8729-64c350538b8a" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Creating volume c467ea55-e362-4765-8729-64c350538b8a from snapshot 10e48bc3-48dd-43ad-8a83-dbd42b6b341f {{(pid=82569) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Acquiring lock "cinder-quobyte-c467ea55-e362-4765-8729-64c350538b8a" by "_copy_volume_from_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Lock "cinder-quobyte-c467ea55-e362-4765-8729-64c350538b8a" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] snapshot: 10e48bc3-48dd-43ad-8a83-dbd42b6b341f, volume: c467ea55-e362-4765-8729-64c350538b8a, {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[c102bb2a-4dcf-4a67-b878-287e584d9ebe]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.10e48bc3-48dd-43ad-8a83-dbd42b6b341f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:23 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.10e48bc3-48dd-43ad-8a83-dbd42b6b341f Apr 16 19:50:23 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-18c4d255-b2db-49bf-b938-611c381e854d tempest-CreateVolumesFromImageTest-1473269475 None] Acquiring lock "cinder-67cefc9f-2e85-45b8-8674-3045333669a1-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-18c4d255-b2db-49bf-b938-611c381e854d tempest-CreateVolumesFromImageTest-1473269475 None] Lock "cinder-67cefc9f-2e85-45b8-8674-3045333669a1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:23 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-18c4d255-b2db-49bf-b938-611c381e854d tempest-CreateVolumesFromImageTest-1473269475 None] Acquiring lock "cinder-quobyte-67cefc9f-2e85-45b8-8674-3045333669a1" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-18c4d255-b2db-49bf-b938-611c381e854d tempest-CreateVolumesFromImageTest-1473269475 None] Lock "cinder-quobyte-67cefc9f-2e85-45b8-8674-3045333669a1" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36604f5-d05a-4a70-8796-3dad4e947a13]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-18c4d255-b2db-49bf-b938-611c381e854d tempest-CreateVolumesFromImageTest-1473269475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-67cefc9f-2e85-45b8-8674-3045333669a1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:24 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-67cefc9f-2e85-45b8-8674-3045333669a1 Apr 16 19:50:24 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:24 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.10e48bc3-48dd-43ad-8a83-dbd42b6b341f" returned: 0 in 0.608s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Creating direct copy from snapshot {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e16c0e3-2126-4f80-bab9-1ce1574e7375]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:24 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c Apr 16 19:50:24 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:24 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-18c4d255-b2db-49bf-b938-611c381e854d tempest-CreateVolumesFromImageTest-1473269475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-67cefc9f-2e85-45b8-8674-3045333669a1" returned: 0 in 0.606s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-18c4d255-b2db-49bf-b938-611c381e854d tempest-CreateVolumesFromImageTest-1473269475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-67cefc9f-2e85-45b8-8674-3045333669a1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:24 devstack sudo[90271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-67cefc9f-2e85-45b8-8674-3045333669a1 Apr 16 19:50:24 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Flow 'volume_create_manager' (6c5d5c75-fcce-46b3-937b-3b7ea40b7b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b11a22f-7064-4cd3-bff5-3d751a5072de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b11a22f-7064-4cd3-bff5-3d751a5072de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-921914347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c31a9628-58a1-471a-a624-ee3d176ac87b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='632f9af2863d4ac39c086d190222e685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:25Z,use_quota=True,user_id='f0b12fb2e1a54c3492d0840a1737f800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d943ca4-b141-4327-bf7a-6b19de8d2169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d943ca4-b141-4327-bf7a-6b19de8d2169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6cfbee8-8f7a-453c-a6eb-d60b5a720ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6cfbee8-8f7a-453c-a6eb-d60b5a720ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c31a9628-58a1-471a-a624-ee3d176ac87b', 'volume_name': 'volume-c31a9628-58a1-471a-a624-ee3d176ac87b', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbdb60ea-477c-464d-8b04-cbc3597d3902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbdb60ea-477c-464d-8b04-cbc3597d3902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3289bad-740d-4d4e-8871-9b5d7b1a39f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:24 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Volume c31a9628-58a1-471a-a624-ee3d176ac87b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c31a9628-58a1-471a-a624-ee3d176ac87b', 'volume_size': 1} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Flow 'volume_create_manager' (5b582732-89e4-4d32-ae26-8139410a9552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b9503a-bf03-4c32-a6b0-2a72c89b8f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b9503a-bf03-4c32-a6b0-2a72c89b8f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-51235848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15436e68-1a08-4b2b-8e19-3a831243b4d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a97acd3df244290a11ff735ee8e60f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:25Z,use_quota=True,user_id='7fd3dc57181243c6a6d7f42b72ff9700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (308e56ec-1f5e-4fc6-8343-021e7d69b791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (308e56ec-1f5e-4fc6-8343-021e7d69b791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee35b72f-3e15-483f-bfa7-ee0cc7dd64eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee35b72f-3e15-483f-bfa7-ee0cc7dd64eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15436e68-1a08-4b2b-8e19-3a831243b4d0', 'volume_name': 'volume-15436e68-1a08-4b2b-8e19-3a831243b4d0', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82519edf-aa1e-4ea7-bcb1-2d0469d4e226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:24 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82519edf-aa1e-4ea7-bcb1-2d0469d4e226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e047c59-e7e1-4bed-ae86-4dab427bbb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:24 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Volume 15436e68-1a08-4b2b-8e19-3a831243b4d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15436e68-1a08-4b2b-8e19-3a831243b4d0', 'volume_size': 1} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c" returned: 0 in 0.594s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG cinder.utils [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Path /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c467ea55-e362-4765-8729-64c350538b8a not found in is_blk_device check {{(pid=82569) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 19:50:24 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c467ea55-e362-4765-8729-64c350538b8a {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:25 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c467ea55-e362-4765-8729-64c350538b8a Apr 16 19:50:25 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Flow 'volume_create_manager' (53fe3de1-8e96-439d-8b6a-255c869f5041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5ec00c-96eb-49e0-a462-01f1cf1164e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5ec00c-96eb-49e0-a462-01f1cf1164e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-321994000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d02c83a8-9629-461b-81d7-8719979bc746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a97acd3df244290a11ff735ee8e60f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:25Z,use_quota=True,user_id='7fd3dc57181243c6a6d7f42b72ff9700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e742e58c-5ce1-4211-9d03-5f1a4344c846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e742e58c-5ce1-4211-9d03-5f1a4344c846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7029b847-da8b-4278-8226-1fcc716f97b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7029b847-da8b-4278-8226-1fcc716f97b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd02c83a8-9629-461b-81d7-8719979bc746', 'volume_name': 'volume-d02c83a8-9629-461b-81d7-8719979bc746', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a81e3e4-8818-4870-9d5a-2f8854ee56a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a81e3e4-8818-4870-9d5a-2f8854ee56a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4181c79-4a17-47ae-95f5-9af6c29f6582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:25 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Volume d02c83a8-9629-461b-81d7-8719979bc746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d02c83a8-9629-461b-81d7-8719979bc746', 'volume_size': 1} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:25 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-18c4d255-b2db-49bf-b938-611c381e854d tempest-CreateVolumesFromImageTest-1473269475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-67cefc9f-2e85-45b8-8674-3045333669a1" returned: 0 in 0.616s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-18c4d255-b2db-49bf-b938-611c381e854d tempest-CreateVolumesFromImageTest-1473269475 None] Lock "cinder-quobyte-67cefc9f-2e85-45b8-8674-3045333669a1" released by "delete_volume" :: held 1.248s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-18c4d255-b2db-49bf-b938-611c381e854d tempest-CreateVolumesFromImageTest-1473269475 None] Created reservations ['d29a8fe3-3f70-4cf9-9e02-f2975476c5d9', '3c986dd8-1e27-4fc0-97df-b5ff97e83519', 'ad8cffcd-2df2-459c-b873-80f905fdb59f', '2b8a2bc1-620d-4684-83a8-6803b7878bcf'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Flow 'volume_create_manager' (1f71ead6-cb83-45ed-8e0d-52618682f288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2292afbf-baf4-4474-a1a8-a258d502e2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2292afbf-baf4-4474-a1a8-a258d502e2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1476166545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15de910b-7872-4ee2-b50c-dd8e7f68a931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a97acd3df244290a11ff735ee8e60f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:25Z,use_quota=True,user_id='7fd3dc57181243c6a6d7f42b72ff9700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ae448c-0497-46e7-b07d-515e452d66ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ae448c-0497-46e7-b07d-515e452d66ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31143a40-b362-4bec-ad13-f5bd74f28925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31143a40-b362-4bec-ad13-f5bd74f28925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15de910b-7872-4ee2-b50c-dd8e7f68a931', 'volume_name': 'volume-15de910b-7872-4ee2-b50c-dd8e7f68a931', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7402a5fc-fcf5-44f8-9233-8f23e53dcca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7402a5fc-fcf5-44f8-9233-8f23e53dcca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a21fc3-efc9-4136-8ea9-efccd338e7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:25 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Volume 15de910b-7872-4ee2-b50c-dd8e7f68a931: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15de910b-7872-4ee2-b50c-dd8e7f68a931', 'volume_size': 1} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-18c4d255-b2db-49bf-b938-611c381e854d tempest-CreateVolumesFromImageTest-1473269475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-18c4d255-b2db-49bf-b938-611c381e854d tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-18c4d255-b2db-49bf-b938-611c381e854d tempest-CreateVolumesFromImageTest-1473269475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-18c4d255-b2db-49bf-b938-611c381e854d tempest-CreateVolumesFromImageTest-1473269475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-18c4d255-b2db-49bf-b938-611c381e854d tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-18c4d255-b2db-49bf-b938-611c381e854d tempest-CreateVolumesFromImageTest-1473269475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:25 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:50:25 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Flow 'volume_create_manager' (37ce9ac1-077e-489f-8d33-e943eeee5e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a35e8f1-f1f6-4e45-a039-ff9df50d7f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a35e8f1-f1f6-4e45-a039-ff9df50d7f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-500441188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f6caeb-870b-48f6-9f78-f4bedef7e954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a97acd3df244290a11ff735ee8e60f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:26Z,use_quota=True,user_id='7fd3dc57181243c6a6d7f42b72ff9700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2b0a13f-ccb8-48fd-827c-33892db0b6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2b0a13f-ccb8-48fd-827c-33892db0b6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb033fc6-6b4b-4580-9108-574bd8321542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb033fc6-6b4b-4580-9108-574bd8321542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0f6caeb-870b-48f6-9f78-f4bedef7e954', 'volume_name': 'volume-f0f6caeb-870b-48f6-9f78-f4bedef7e954', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2985cc4-9e27-44df-9600-089457a3a07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2985cc4-9e27-44df-9600-089457a3a07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7688b185-5f16-4627-951c-0be34108b080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:25 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Volume f0f6caeb-870b-48f6-9f78-f4bedef7e954: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0f6caeb-870b-48f6-9f78-f4bedef7e954', 'volume_size': 1} Apr 16 19:50:25 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:26 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-88de3917-8130-4cd6-9478-222acf20da37 tempest-CreateVolumesFromImageTest-1473269475 None] Acquiring lock "cinder-b1fd4245-bf40-4b45-8950-f912544d6476-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:26 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-88de3917-8130-4cd6-9478-222acf20da37 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "cinder-b1fd4245-bf40-4b45-8950-f912544d6476-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:26 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:50:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Flow 'volume_create_manager' (7cf8d1d3-fbe2-4830-8521-425584d4f715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:26 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4c5b1a-8d93-497e-b9e4-4c881989fdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4c5b1a-8d93-497e-b9e4-4c881989fdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-234820707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a27ccc-c265-48b5-89d6-4fc677a7a3f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a97acd3df244290a11ff735ee8e60f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:26Z,use_quota=True,user_id='7fd3dc57181243c6a6d7f42b72ff9700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab07ed46-f21a-42f3-9eeb-cf0b9191993d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab07ed46-f21a-42f3-9eeb-cf0b9191993d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b871d6-5985-4635-9794-b47576420af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b871d6-5985-4635-9794-b47576420af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1a27ccc-c265-48b5-89d6-4fc677a7a3f1', 'volume_name': 'volume-c1a27ccc-c265-48b5-89d6-4fc677a7a3f1', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a98bdc-a80b-447b-8f90-017e711d3c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a98bdc-a80b-447b-8f90-017e711d3c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:26 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5510525a-25be-4a8f-89c4-108c4b41236e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:26 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Volume c1a27ccc-c265-48b5-89d6-4fc677a7a3f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1a27ccc-c265-48b5-89d6-4fc677a7a3f1', 'volume_size': 1} Apr 16 19:50:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-18c4d255-b2db-49bf-b938-611c381e854d tempest-CreateVolumesFromImageTest-1473269475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 1.008s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:26 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-18c4d255-b2db-49bf-b938-611c381e854d tempest-CreateVolumesFromImageTest-1473269475 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:50:26 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-88de3917-8130-4cd6-9478-222acf20da37 tempest-CreateVolumesFromImageTest-1473269475 None] Acquiring lock "cinder-quobyte-b1fd4245-bf40-4b45-8950-f912544d6476" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:26 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-18c4d255-b2db-49bf-b938-611c381e854d tempest-CreateVolumesFromImageTest-1473269475 None] Deleted volume successfully. Apr 16 19:50:26 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-88de3917-8130-4cd6-9478-222acf20da37 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "cinder-quobyte-b1fd4245-bf40-4b45-8950-f912544d6476" acquired by "delete_volume" :: waited 0.014s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:26 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-18c4d255-b2db-49bf-b938-611c381e854d tempest-CreateVolumesFromImageTest-1473269475 None] Lock "cinder-67cefc9f-2e85-45b8-8674-3045333669a1-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:26 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f85fc40-2c02-456f-ab9d-17ed739ec775]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:26 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-88de3917-8130-4cd6-9478-222acf20da37 tempest-CreateVolumesFromImageTest-1473269475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b1fd4245-bf40-4b45-8950-f912544d6476 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:26 devstack sudo[90292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b1fd4245-bf40-4b45-8950-f912544d6476 Apr 16 19:50:26 devstack sudo[90292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:27 devstack sudo[90292]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-88de3917-8130-4cd6-9478-222acf20da37 tempest-CreateVolumesFromImageTest-1473269475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b1fd4245-bf40-4b45-8950-f912544d6476" returned: 0 in 0.983s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-88de3917-8130-4cd6-9478-222acf20da37 tempest-CreateVolumesFromImageTest-1473269475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b1fd4245-bf40-4b45-8950-f912544d6476 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:27 devstack sudo[90297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b1fd4245-bf40-4b45-8950-f912544d6476 Apr 16 19:50:27 devstack sudo[90297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:27 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c467ea55-e362-4765-8729-64c350538b8a" returned: 0 in 2.525s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:27 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11dad2f-a7c4-45c8-87fc-69f3941d2b26]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:27 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c Apr 16 19:50:27 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:27 devstack sudo[90297]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-88de3917-8130-4cd6-9478-222acf20da37 tempest-CreateVolumesFromImageTest-1473269475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b1fd4245-bf40-4b45-8950-f912544d6476" returned: 0 in 0.418s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:27 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-88de3917-8130-4cd6-9478-222acf20da37 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "cinder-quobyte-b1fd4245-bf40-4b45-8950-f912544d6476" released by "delete_volume" :: held 1.442s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:27 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-88de3917-8130-4cd6-9478-222acf20da37 tempest-CreateVolumesFromImageTest-1473269475 None] Created reservations ['6aa793db-1e26-413e-8e0f-664e50116f1c', 'a468974c-9d2e-4280-a9d4-6cbaa0982b25', '5b38d3e2-c9cb-417e-b5ac-b4a985e4f4e1', 'ba624589-3aa6-43d3-87b8-d61f7cc00b3a'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:50:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-88de3917-8130-4cd6-9478-222acf20da37 tempest-CreateVolumesFromImageTest-1473269475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-88de3917-8130-4cd6-9478-222acf20da37 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:27 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-88de3917-8130-4cd6-9478-222acf20da37 tempest-CreateVolumesFromImageTest-1473269475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:27 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-88de3917-8130-4cd6-9478-222acf20da37 tempest-CreateVolumesFromImageTest-1473269475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-88de3917-8130-4cd6-9478-222acf20da37 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:27 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-88de3917-8130-4cd6-9478-222acf20da37 tempest-CreateVolumesFromImageTest-1473269475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:27 devstack sudo[90304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:50:27 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:28 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c" returned: 0 in 0.619s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:28 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Image conversion details: src /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c, size 1024.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c467ea55-e362-4765-8729-64c350538b8a {{(pid=82569) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 19:50:28 devstack cinder-volume[82569]: INFO cinder.image.image_utils [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Converted 1024.00 MB image at 405.41 MB/s Apr 16 19:50:28 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c467ea55-e362-4765-8729-64c350538b8a is being set with open permissions: ugo+rw Apr 16 19:50:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c467ea55-e362-4765-8729-64c350538b8a {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:28 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c467ea55-e362-4765-8729-64c350538b8a Apr 16 19:50:28 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:28 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-88de3917-8130-4cd6-9478-222acf20da37 tempest-CreateVolumesFromImageTest-1473269475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.431s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:28 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-88de3917-8130-4cd6-9478-222acf20da37 tempest-CreateVolumesFromImageTest-1473269475 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:50:28 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-88de3917-8130-4cd6-9478-222acf20da37 tempest-CreateVolumesFromImageTest-1473269475 None] Deleted volume successfully. Apr 16 19:50:28 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-88de3917-8130-4cd6-9478-222acf20da37 tempest-CreateVolumesFromImageTest-1473269475 None] Lock "cinder-b1fd4245-bf40-4b45-8950-f912544d6476-delete_volume" released by "delete_volume" :: held 2.171s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:28 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c467ea55-e362-4765-8729-64c350538b8a" returned: 0 in 0.434s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:28 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Lock "cinder-quobyte-c467ea55-e362-4765-8729-64c350538b8a" released by "_copy_volume_from_snapshot" :: held 4.845s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:28 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Lock "cinder-quobyte-10e48bc3-48dd-43ad-8a83-dbd42b6b341f-c467ea55-e362-4765-8729-64c350538b8a" released by "_create_volume_from_snapshot" :: held 4.868s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.889s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.704s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:28 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-921914347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c31a9628-58a1-471a-a624-ee3d176ac87b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='632f9af2863d4ac39c086d190222e685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:25Z,use_quota=True,user_id='f0b12fb2e1a54c3492d0840a1737f800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:50:28 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Creating volume c31a9628-58a1-471a-a624-ee3d176ac87b {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:50:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:28 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:28 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:28 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:50:28 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:50:28 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:28 devstack sudo[90311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b 1073741824 Apr 16 19:50:28 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:28 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f391d08-ad20-4082-a735-eea0d6d9eea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c467ea55-e362-4765-8729-64c350538b8a', 'volume_size': 1, 'snapshot_id': '10e48bc3-48dd-43ad-8a83-dbd42b6b341f'}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:28 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec96dbd-61aa-4e03-9715-a76eb56fd490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:28 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Volume volume-c467ea55-e362-4765-8729-64c350538b8a (c467ea55-e362-4765-8729-64c350538b8a): created successfully Apr 16 19:50:28 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec96dbd-61aa-4e03-9715-a76eb56fd490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:28 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Flow 'volume_create_manager' (257b8ba2-805e-4c16-9556-b5246cf7616e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:28 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-6e600092-75b2-4091-92ae-c35eb4ab4615 tempest-VolumeDependencyTests-669614506 None] Created volume successfully. Apr 16 19:50:29 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a463030f-e13c-4d4b-9bb7-14514b5fea86 tempest-VolumeDependencyTests-669614506 None] Acquiring lock "cinder-10e48bc3-48dd-43ad-8a83-dbd42b6b341f-delete_snapshot" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b 1073741824" returned: 0 in 0.601s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a463030f-e13c-4d4b-9bb7-14514b5fea86 tempest-VolumeDependencyTests-669614506 None] Lock "cinder-10e48bc3-48dd-43ad-8a83-dbd42b6b341f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a463030f-e13c-4d4b-9bb7-14514b5fea86 tempest-VolumeDependencyTests-669614506 None] Acquiring lock "cinder-quobyte-56ed6ca0-0994-4a62-8e3c-8227085faa7c" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a463030f-e13c-4d4b-9bb7-14514b5fea86 tempest-VolumeDependencyTests-669614506 None] Lock "cinder-quobyte-56ed6ca0-0994-4a62-8e3c-8227085faa7c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a463030f-e13c-4d4b-9bb7-14514b5fea86 tempest-VolumeDependencyTests-669614506 None] Acquiring lock "cinder-quobyte-10e48bc3-48dd-43ad-8a83-dbd42b6b341f" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a463030f-e13c-4d4b-9bb7-14514b5fea86 tempest-VolumeDependencyTests-669614506 None] Lock "cinder-quobyte-10e48bc3-48dd-43ad-8a83-dbd42b6b341f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:29 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b Apr 16 19:50:29 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-a463030f-e13c-4d4b-9bb7-14514b5fea86 tempest-VolumeDependencyTests-669614506 None] Deleting offline snapshot 10e48bc3-48dd-43ad-8a83-dbd42b6b341f of volume 56ed6ca0-0994-4a62-8e3c-8227085faa7c {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-a463030f-e13c-4d4b-9bb7-14514b5fea86 tempest-VolumeDependencyTests-669614506 None] snapshot_file for this snap is: volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.10e48bc3-48dd-43ad-8a83-dbd42b6b341f {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d36dcb5-ddd6-49ae-98fc-12efa46748b0]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a463030f-e13c-4d4b-9bb7-14514b5fea86 tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.10e48bc3-48dd-43ad-8a83-dbd42b6b341f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:29 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.10e48bc3-48dd-43ad-8a83-dbd42b6b341f Apr 16 19:50:29 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:29 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b" returned: 0 in 0.509s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.771s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-51235848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15436e68-1a08-4b2b-8e19-3a831243b4d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a97acd3df244290a11ff735ee8e60f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:25Z,use_quota=True,user_id='7fd3dc57181243c6a6d7f42b72ff9700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Creating volume 15436e68-1a08-4b2b-8e19-3a831243b4d0 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:50:29 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-15436e68-1a08-4b2b-8e19-3a831243b4d0 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3289bad-740d-4d4e-8871-9b5d7b1a39f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c31a9628-58a1-471a-a624-ee3d176ac87b', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:29 devstack sudo[90324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-15436e68-1a08-4b2b-8e19-3a831243b4d0 1073741824 Apr 16 19:50:29 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce1dc2bd-7de7-4db5-ba1e-053e63421237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:29 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Volume volume-c31a9628-58a1-471a-a624-ee3d176ac87b (c31a9628-58a1-471a-a624-ee3d176ac87b): created successfully Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce1dc2bd-7de7-4db5-ba1e-053e63421237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Flow 'volume_create_manager' (6c5d5c75-fcce-46b3-937b-3b7ea40b7b75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:29 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-bf9d0184-361b-4ded-9070-89519cc557f7 tempest-SnapshotDependencyTests-1674598386 None] Created volume successfully. Apr 16 19:50:29 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a463030f-e13c-4d4b-9bb7-14514b5fea86 tempest-VolumeDependencyTests-669614506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.10e48bc3-48dd-43ad-8a83-dbd42b6b341f" returned: 0 in 0.554s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-a463030f-e13c-4d4b-9bb7-14514b5fea86 tempest-VolumeDependencyTests-669614506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[3199f484-c903-4f8e-9972-c6c1d834d548]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:29 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a463030f-e13c-4d4b-9bb7-14514b5fea86 tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:29 devstack sudo[90326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c Apr 16 19:50:29 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:30 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-15436e68-1a08-4b2b-8e19-3a831243b4d0 1073741824" returned: 0 in 0.569s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-15436e68-1a08-4b2b-8e19-3a831243b4d0 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:50:30 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-15436e68-1a08-4b2b-8e19-3a831243b4d0 Apr 16 19:50:30 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Flow 'volume_create_manager' (153645dc-ec6d-4f9b-b7d0-dc86c8dde8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a5048c-02bb-42c4-869e-1598d0d4f02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:30 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a5048c-02bb-42c4-869e-1598d0d4f02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d80db18-8cf1-437d-ab5b-9e8be1df09df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7276a2a89b4e43a384248b6961cd0e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:30Z,use_quota=True,user_id='bab1390cea094685b31a52d9b907d421',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3402e0-e7e4-4dcc-8d94-7715edb080ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3402e0-e7e4-4dcc-8d94-7715edb080ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a4059e-2656-44d1-9a61-63547efde5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a4059e-2656-44d1-9a61-63547efde5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d80db18-8cf1-437d-ab5b-9e8be1df09df', 'volume_name': 'volume-9d80db18-8cf1-437d-ab5b-9e8be1df09df', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f9fa46e-e1ef-465b-839f-5d53beb6b766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f9fa46e-e1ef-465b-839f-5d53beb6b766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d39267-576d-458b-8e31-663c809b7840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:30 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Volume 9d80db18-8cf1-437d-ab5b-9e8be1df09df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d80db18-8cf1-437d-ab5b-9e8be1df09df', 'volume_size': 1} Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a463030f-e13c-4d4b-9bb7-14514b5fea86 tempest-VolumeDependencyTests-669614506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c" returned: 0 in 0.676s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a463030f-e13c-4d4b-9bb7-14514b5fea86 tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.10e48bc3-48dd-43ad-8a83-dbd42b6b341f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:30 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.10e48bc3-48dd-43ad-8a83-dbd42b6b341f Apr 16 19:50:30 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-67713881-18d0-4ce3-85ca-da94455a75fd tempest-SnapshotDependencyTests-1674598386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:30 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-15436e68-1a08-4b2b-8e19-3a831243b4d0" returned: 0 in 0.429s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.668s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-321994000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d02c83a8-9629-461b-81d7-8719979bc746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a97acd3df244290a11ff735ee8e60f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:25Z,use_quota=True,user_id='7fd3dc57181243c6a6d7f42b72ff9700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Creating volume d02c83a8-9629-461b-81d7-8719979bc746 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:50:30 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d02c83a8-9629-461b-81d7-8719979bc746 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:30 devstack sudo[90339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d02c83a8-9629-461b-81d7-8719979bc746 1073741824 Apr 16 19:50:30 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e047c59-e7e1-4bed-ae86-4dab427bbb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15436e68-1a08-4b2b-8e19-3a831243b4d0', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40001f8b-036d-49f6-9943-5c3f912afd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:30 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Volume volume-15436e68-1a08-4b2b-8e19-3a831243b4d0 (15436e68-1a08-4b2b-8e19-3a831243b4d0): created successfully Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40001f8b-036d-49f6-9943-5c3f912afd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:30 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Flow 'volume_create_manager' (5b582732-89e4-4d32-ae26-8139410a9552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:30 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-bae91447-402c-4349-8692-cb8c8ea99903 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Created volume successfully. Apr 16 19:50:31 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a463030f-e13c-4d4b-9bb7-14514b5fea86 tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.10e48bc3-48dd-43ad-8a83-dbd42b6b341f" returned: 0 in 0.484s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a463030f-e13c-4d4b-9bb7-14514b5fea86 tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.10e48bc3-48dd-43ad-8a83-dbd42b6b341f {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:31 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.10e48bc3-48dd-43ad-8a83-dbd42b6b341f Apr 16 19:50:31 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:31 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d02c83a8-9629-461b-81d7-8719979bc746 1073741824" returned: 0 in 0.505s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d02c83a8-9629-461b-81d7-8719979bc746 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:31 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d02c83a8-9629-461b-81d7-8719979bc746 Apr 16 19:50:31 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:31 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a463030f-e13c-4d4b-9bb7-14514b5fea86 tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c.10e48bc3-48dd-43ad-8a83-dbd42b6b341f" returned: 0 in 0.438s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:31 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a463030f-e13c-4d4b-9bb7-14514b5fea86 tempest-VolumeDependencyTests-669614506 None] Lock "cinder-quobyte-10e48bc3-48dd-43ad-8a83-dbd42b6b341f" released by "_delete_snapshot" :: held 2.218s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:31 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a463030f-e13c-4d4b-9bb7-14514b5fea86 tempest-VolumeDependencyTests-669614506 None] Lock "cinder-quobyte-56ed6ca0-0994-4a62-8e3c-8227085faa7c" released by "delete_snapshot" :: held 2.239s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:31 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-a463030f-e13c-4d4b-9bb7-14514b5fea86 tempest-VolumeDependencyTests-669614506 None] Created reservations ['08e77cf5-81d0-4821-8439-58e61fca954c', '09a3ef6c-0006-44f1-8f41-bcbb12294af0', '635de89f-367b-4c50-a2a7-dfd3f9800cf5', '4141f851-273c-40f7-8439-7a90f89233e5'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:50:31 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-a463030f-e13c-4d4b-9bb7-14514b5fea86 tempest-VolumeDependencyTests-669614506 None] Delete snapshot completed successfully. Apr 16 19:50:31 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a463030f-e13c-4d4b-9bb7-14514b5fea86 tempest-VolumeDependencyTests-669614506 None] Lock "cinder-10e48bc3-48dd-43ad-8a83-dbd42b6b341f-delete_snapshot" released by "delete_snapshot" :: held 2.339s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:31 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d02c83a8-9629-461b-81d7-8719979bc746" returned: 0 in 0.449s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:31 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:50:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.448s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:31 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1476166545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15de910b-7872-4ee2-b50c-dd8e7f68a931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a97acd3df244290a11ff735ee8e60f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:25Z,use_quota=True,user_id='7fd3dc57181243c6a6d7f42b72ff9700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:50:31 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Creating volume 15de910b-7872-4ee2-b50c-dd8e7f68a931 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:50:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:31 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:31 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:31 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:50:31 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:50:31 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-15de910b-7872-4ee2-b50c-dd8e7f68a931 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:31 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4181c79-4a17-47ae-95f5-9af6c29f6582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d02c83a8-9629-461b-81d7-8719979bc746', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:31 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-15de910b-7872-4ee2-b50c-dd8e7f68a931 1073741824 Apr 16 19:50:31 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:31 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56445292-a7c3-4453-8fb6-2b0a8beb9fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:31 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Volume volume-d02c83a8-9629-461b-81d7-8719979bc746 (d02c83a8-9629-461b-81d7-8719979bc746): created successfully Apr 16 19:50:31 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56445292-a7c3-4453-8fb6-2b0a8beb9fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:31 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Flow 'volume_create_manager' (53fe3de1-8e96-439d-8b6a-255c869f5041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:31 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-1ee62866-b350-440c-95f5-360c92020b34 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Created volume successfully. Apr 16 19:50:32 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9f40d13b-1fb8-4da9-9242-1c3791dfc5e4 tempest-VolumeDependencyTests-669614506 None] Acquiring lock "cinder-56ed6ca0-0994-4a62-8e3c-8227085faa7c-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:32 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:32 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9f40d13b-1fb8-4da9-9242-1c3791dfc5e4 tempest-VolumeDependencyTests-669614506 None] Lock "cinder-56ed6ca0-0994-4a62-8e3c-8227085faa7c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-15de910b-7872-4ee2-b50c-dd8e7f68a931 1073741824" returned: 0 in 0.508s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:32 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9f40d13b-1fb8-4da9-9242-1c3791dfc5e4 tempest-VolumeDependencyTests-669614506 None] Acquiring lock "cinder-quobyte-56ed6ca0-0994-4a62-8e3c-8227085faa7c" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-15de910b-7872-4ee2-b50c-dd8e7f68a931 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:32 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-15de910b-7872-4ee2-b50c-dd8e7f68a931 Apr 16 19:50:32 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9f40d13b-1fb8-4da9-9242-1c3791dfc5e4 tempest-VolumeDependencyTests-669614506 None] Lock "cinder-quobyte-56ed6ca0-0994-4a62-8e3c-8227085faa7c" acquired by "delete_volume" :: waited 0.019s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:32 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:32 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1bcfe5-4e17-4024-a2d0-da866d117ed8]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f40d13b-1fb8-4da9-9242-1c3791dfc5e4 tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:32 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c Apr 16 19:50:32 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:32 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-15de910b-7872-4ee2-b50c-dd8e7f68a931" returned: 0 in 0.454s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:32 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:50:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.188s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:32 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-500441188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f6caeb-870b-48f6-9f78-f4bedef7e954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a97acd3df244290a11ff735ee8e60f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:26Z,use_quota=True,user_id='7fd3dc57181243c6a6d7f42b72ff9700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:50:32 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Creating volume f0f6caeb-870b-48f6-9f78-f4bedef7e954 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:50:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:32 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:32 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:32 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:50:32 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:50:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0f6caeb-870b-48f6-9f78-f4bedef7e954 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a21fc3-efc9-4136-8ea9-efccd338e7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15de910b-7872-4ee2-b50c-dd8e7f68a931', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:32 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0f6caeb-870b-48f6-9f78-f4bedef7e954 1073741824 Apr 16 19:50:32 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5012c35f-2bb0-489a-a180-403f0233d6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:32 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Volume volume-15de910b-7872-4ee2-b50c-dd8e7f68a931 (15de910b-7872-4ee2-b50c-dd8e7f68a931): created successfully Apr 16 19:50:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5012c35f-2bb0-489a-a180-403f0233d6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:32 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Flow 'volume_create_manager' (1f71ead6-cb83-45ed-8e0d-52618682f288) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:32 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-aba1da11-3491-4ac3-8a3b-3869db24c5a4 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Created volume successfully. Apr 16 19:50:32 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f40d13b-1fb8-4da9-9242-1c3791dfc5e4 tempest-VolumeDependencyTests-669614506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c" returned: 0 in 0.508s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:32 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f40d13b-1fb8-4da9-9242-1c3791dfc5e4 tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:32 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c Apr 16 19:50:32 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:33 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0f6caeb-870b-48f6-9f78-f4bedef7e954 1073741824" returned: 0 in 0.478s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:33 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f40d13b-1fb8-4da9-9242-1c3791dfc5e4 tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-56ed6ca0-0994-4a62-8e3c-8227085faa7c" returned: 0 in 0.410s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9f40d13b-1fb8-4da9-9242-1c3791dfc5e4 tempest-VolumeDependencyTests-669614506 None] Lock "cinder-quobyte-56ed6ca0-0994-4a62-8e3c-8227085faa7c" released by "delete_volume" :: held 0.956s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0f6caeb-870b-48f6-9f78-f4bedef7e954 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:33 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0f6caeb-870b-48f6-9f78-f4bedef7e954 Apr 16 19:50:33 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-9f40d13b-1fb8-4da9-9242-1c3791dfc5e4 tempest-VolumeDependencyTests-669614506 None] Created reservations ['ff56053c-89d9-4aa6-8ed1-55430ca69802', '4d86c6af-9e24-46b1-b7db-c81a56c2bca0', 'afe8cfae-8620-4117-ac5e-3cb90031bf32', '32199733-6034-4d8b-a570-b300c9d7ee79'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9f40d13b-1fb8-4da9-9242-1c3791dfc5e4 tempest-VolumeDependencyTests-669614506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9f40d13b-1fb8-4da9-9242-1c3791dfc5e4 tempest-VolumeDependencyTests-669614506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-9f40d13b-1fb8-4da9-9242-1c3791dfc5e4 tempest-VolumeDependencyTests-669614506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-9f40d13b-1fb8-4da9-9242-1c3791dfc5e4 tempest-VolumeDependencyTests-669614506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-9f40d13b-1fb8-4da9-9242-1c3791dfc5e4 tempest-VolumeDependencyTests-669614506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f40d13b-1fb8-4da9-9242-1c3791dfc5e4 tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:33 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:50:33 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:33 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0f6caeb-870b-48f6-9f78-f4bedef7e954" returned: 0 in 0.436s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.401s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-234820707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a27ccc-c265-48b5-89d6-4fc677a7a3f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a97acd3df244290a11ff735ee8e60f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:26Z,use_quota=True,user_id='7fd3dc57181243c6a6d7f42b72ff9700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Creating volume c1a27ccc-c265-48b5-89d6-4fc677a7a3f1 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:50:33 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c1a27ccc-c265-48b5-89d6-4fc677a7a3f1 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7688b185-5f16-4627-951c-0be34108b080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0f6caeb-870b-48f6-9f78-f4bedef7e954', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a27a11-11c4-4aa6-bd42-ad6ba289ada9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:33 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c1a27ccc-c265-48b5-89d6-4fc677a7a3f1 1073741824 Apr 16 19:50:33 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:33 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Volume volume-f0f6caeb-870b-48f6-9f78-f4bedef7e954 (f0f6caeb-870b-48f6-9f78-f4bedef7e954): created successfully Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a27a11-11c4-4aa6-bd42-ad6ba289ada9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Flow 'volume_create_manager' (37ce9ac1-077e-489f-8d33-e943eeee5e18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:33 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-701de371-4bf6-4851-b131-6a473c26d1ae tempest-CreateVolumesFromSnapshotTest-1828106995 None] Created volume successfully. Apr 16 19:50:33 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-9f40d13b-1fb8-4da9-9242-1c3791dfc5e4 tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.437s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-9f40d13b-1fb8-4da9-9242-1c3791dfc5e4 tempest-VolumeDependencyTests-669614506 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:50:33 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-9f40d13b-1fb8-4da9-9242-1c3791dfc5e4 tempest-VolumeDependencyTests-669614506 None] Deleted volume successfully. Apr 16 19:50:33 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-9f40d13b-1fb8-4da9-9242-1c3791dfc5e4 tempest-VolumeDependencyTests-669614506 None] Lock "cinder-56ed6ca0-0994-4a62-8e3c-8227085faa7c-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:34 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c1a27ccc-c265-48b5-89d6-4fc677a7a3f1 1073741824" returned: 0 in 0.477s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c1a27ccc-c265-48b5-89d6-4fc677a7a3f1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:34 devstack sudo[90386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c1a27ccc-c265-48b5-89d6-4fc677a7a3f1 Apr 16 19:50:34 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:34 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c1a27ccc-c265-48b5-89d6-4fc677a7a3f1" returned: 0 in 0.440s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.235s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d80db18-8cf1-437d-ab5b-9e8be1df09df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7276a2a89b4e43a384248b6961cd0e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:30Z,use_quota=True,user_id='bab1390cea094685b31a52d9b907d421',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Creating volume 9d80db18-8cf1-437d-ab5b-9e8be1df09df {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:50:34 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-9d80db18-8cf1-437d-ab5b-9e8be1df09df 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:50:34 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-9d80db18-8cf1-437d-ab5b-9e8be1df09df 1073741824 Apr 16 19:50:34 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Flow 'volume_create_manager' (0943be06-56ad-4a12-9ff2-ce557d3d0326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3524c0c-3aae-4d67-9394-36956f584fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3524c0c-3aae-4d67-9394-36956f584fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1792652962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e7afa66-7505-4385-b06c-7047cbe8b4d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55701d1c82e40a598769214a003be30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:35Z,use_quota=True,user_id='93e3aa68523b478e8228dc3dcaa7afcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2642f6a6-aff8-4dff-ad95-3dc48bebf490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2642f6a6-aff8-4dff-ad95-3dc48bebf490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0821f923-7fd9-4f56-8377-cf319be9a986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0821f923-7fd9-4f56-8377-cf319be9a986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e7afa66-7505-4385-b06c-7047cbe8b4d1', 'volume_name': 'volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55196a0c-b753-4f7f-b814-829857064e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55196a0c-b753-4f7f-b814-829857064e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (281a3348-850e-4f3b-87c4-cc43302d6104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:34 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Volume 0e7afa66-7505-4385-b06c-7047cbe8b4d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1', 'volume_size': 1} Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5510525a-25be-4a8f-89c4-108c4b41236e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1a27ccc-c265-48b5-89d6-4fc677a7a3f1', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b8e98d-93f0-4338-96ca-4c8ea9343be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:34 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Volume volume-c1a27ccc-c265-48b5-89d6-4fc677a7a3f1 (c1a27ccc-c265-48b5-89d6-4fc677a7a3f1): created successfully Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b8e98d-93f0-4338-96ca-4c8ea9343be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:34 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Flow 'volume_create_manager' (7cf8d1d3-fbe2-4830-8521-425584d4f715) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:34 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-f227ab3f-af72-41a1-8759-10abe1677c3b tempest-CreateVolumesFromSnapshotTest-1828106995 None] Created volume successfully. Apr 16 19:50:35 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-db630782-cb1c-4dca-aa7c-42bcb31f1831 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "cinder-c1a27ccc-c265-48b5-89d6-4fc677a7a3f1-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:35 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-db630782-cb1c-4dca-aa7c-42bcb31f1831 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-c1a27ccc-c265-48b5-89d6-4fc677a7a3f1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:35 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-db630782-cb1c-4dca-aa7c-42bcb31f1831 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "cinder-quobyte-c1a27ccc-c265-48b5-89d6-4fc677a7a3f1" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:35 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-db630782-cb1c-4dca-aa7c-42bcb31f1831 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-quobyte-c1a27ccc-c265-48b5-89d6-4fc677a7a3f1" acquired by "delete_volume" :: waited 0.021s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:35 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[05489075-e19e-462f-8541-1dd11ec612aa]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-db630782-cb1c-4dca-aa7c-42bcb31f1831 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c1a27ccc-c265-48b5-89d6-4fc677a7a3f1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:35 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c1a27ccc-c265-48b5-89d6-4fc677a7a3f1 Apr 16 19:50:35 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:35 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-9d80db18-8cf1-437d-ab5b-9e8be1df09df 1073741824" returned: 0 in 0.508s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-9d80db18-8cf1-437d-ab5b-9e8be1df09df {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:35 devstack sudo[90396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-9d80db18-8cf1-437d-ab5b-9e8be1df09df Apr 16 19:50:35 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:35 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-db630782-cb1c-4dca-aa7c-42bcb31f1831 tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c1a27ccc-c265-48b5-89d6-4fc677a7a3f1" returned: 0 in 0.509s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-db630782-cb1c-4dca-aa7c-42bcb31f1831 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c1a27ccc-c265-48b5-89d6-4fc677a7a3f1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:35 devstack sudo[90401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c1a27ccc-c265-48b5-89d6-4fc677a7a3f1 Apr 16 19:50:35 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:35 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-9d80db18-8cf1-437d-ab5b-9e8be1df09df" returned: 0 in 0.442s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:35 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:50:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-67713881-18d0-4ce3-85ca-da94455a75fd tempest-SnapshotDependencyTests-1674598386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.192s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:35 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-67713881-18d0-4ce3-85ca-da94455a75fd tempest-SnapshotDependencyTests-1674598386 None] Creating offline snapshot 36f1d54b-06ba-4170-8b67-7a8e72be9666 of volume c31a9628-58a1-471a-a624-ee3d176ac87b {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:50:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d39267-576d-458b-8e31-663c809b7840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d80db18-8cf1-437d-ab5b-9e8be1df09df', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51103e6-f91b-4348-8989-2a87f3195b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:35 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d21326-03cf-419d-9295-13d081798249]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:35 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-67713881-18d0-4ce3-85ca-da94455a75fd tempest-SnapshotDependencyTests-1674598386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:35 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Volume volume-9d80db18-8cf1-437d-ab5b-9e8be1df09df (9d80db18-8cf1-437d-ab5b-9e8be1df09df): created successfully Apr 16 19:50:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51103e6-f91b-4348-8989-2a87f3195b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:35 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Flow 'volume_create_manager' (153645dc-ec6d-4f9b-b7d0-dc86c8dde8b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:35 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-0e36c0aa-c380-4d6d-b1aa-dfcd14200bf2 tempest-CinderUnicodeTest-380732806 None] Created volume successfully. Apr 16 19:50:35 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b Apr 16 19:50:35 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:36 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-db630782-cb1c-4dca-aa7c-42bcb31f1831 tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c1a27ccc-c265-48b5-89d6-4fc677a7a3f1" returned: 0 in 0.419s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:36 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-db630782-cb1c-4dca-aa7c-42bcb31f1831 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-quobyte-c1a27ccc-c265-48b5-89d6-4fc677a7a3f1" released by "delete_volume" :: held 0.949s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:36 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-db630782-cb1c-4dca-aa7c-42bcb31f1831 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Created reservations ['bdb7cae4-1045-479d-9aed-e96f454115fe', 'f8d26d45-e789-4299-b8b9-0431c1b377fd', '2ecbb320-3b99-4806-b4a6-db1c3f97d5c3', 'ec135631-3c8d-4f92-b994-731fde753826'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:50:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-db630782-cb1c-4dca-aa7c-42bcb31f1831 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-db630782-cb1c-4dca-aa7c-42bcb31f1831 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:36 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-db630782-cb1c-4dca-aa7c-42bcb31f1831 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:36 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-db630782-cb1c-4dca-aa7c-42bcb31f1831 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-db630782-cb1c-4dca-aa7c-42bcb31f1831 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-db630782-cb1c-4dca-aa7c-42bcb31f1831 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:36 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:50:36 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:36 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e7e706c9-ae76-4f73-82bd-ebdcf1729c67 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "cinder-f0f6caeb-870b-48f6-9f78-f4bedef7e954-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:36 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e7e706c9-ae76-4f73-82bd-ebdcf1729c67 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-f0f6caeb-870b-48f6-9f78-f4bedef7e954-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:36 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e7e706c9-ae76-4f73-82bd-ebdcf1729c67 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "cinder-quobyte-f0f6caeb-870b-48f6-9f78-f4bedef7e954" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:36 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e7e706c9-ae76-4f73-82bd-ebdcf1729c67 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-quobyte-f0f6caeb-870b-48f6-9f78-f4bedef7e954" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:36 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3716c48-34be-4ac7-b56f-282a06367934]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e7e706c9-ae76-4f73-82bd-ebdcf1729c67 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0f6caeb-870b-48f6-9f78-f4bedef7e954 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:36 devstack sudo[90411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0f6caeb-870b-48f6-9f78-f4bedef7e954 Apr 16 19:50:36 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:36 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-67713881-18d0-4ce3-85ca-da94455a75fd tempest-SnapshotDependencyTests-1674598386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b" returned: 0 in 0.498s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-67713881-18d0-4ce3-85ca-da94455a75fd tempest-SnapshotDependencyTests-1674598386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.36f1d54b-06ba-4170-8b67-7a8e72be9666 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:36 devstack sudo[90414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.36f1d54b-06ba-4170-8b67-7a8e72be9666 1G Apr 16 19:50:36 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:36 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-db630782-cb1c-4dca-aa7c-42bcb31f1831 tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.456s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:36 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-db630782-cb1c-4dca-aa7c-42bcb31f1831 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:50:36 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-db630782-cb1c-4dca-aa7c-42bcb31f1831 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Deleted volume successfully. Apr 16 19:50:36 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-db630782-cb1c-4dca-aa7c-42bcb31f1831 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-c1a27ccc-c265-48b5-89d6-4fc677a7a3f1-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:36 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e7e706c9-ae76-4f73-82bd-ebdcf1729c67 tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0f6caeb-870b-48f6-9f78-f4bedef7e954" returned: 0 in 0.550s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e7e706c9-ae76-4f73-82bd-ebdcf1729c67 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0f6caeb-870b-48f6-9f78-f4bedef7e954 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:36 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0f6caeb-870b-48f6-9f78-f4bedef7e954 Apr 16 19:50:36 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:36 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-67713881-18d0-4ce3-85ca-da94455a75fd tempest-SnapshotDependencyTests-1674598386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.36f1d54b-06ba-4170-8b67-7a8e72be9666 1G" returned: 0 in 0.567s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:36 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-67713881-18d0-4ce3-85ca-da94455a75fd tempest-SnapshotDependencyTests-1674598386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c31a9628-58a1-471a-a624-ee3d176ac87b -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.36f1d54b-06ba-4170-8b67-7a8e72be9666 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:36 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c31a9628-58a1-471a-a624-ee3d176ac87b -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.36f1d54b-06ba-4170-8b67-7a8e72be9666 Apr 16 19:50:36 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:36 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Flow 'volume_create_manager' (61429654-cd17-47e8-81cf-99af37520d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1a92e4-f0b9-4f2d-8c5f-62bb49d7d267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1a92e4-f0b9-4f2d-8c5f-62bb49d7d267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2063078089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d1a037-9b75-4ae4-bfc5-478ee15f0f40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7276a2a89b4e43a384248b6961cd0e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:37Z,use_quota=True,user_id='bab1390cea094685b31a52d9b907d421',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9eae10f-8ed1-4e50-8ae7-8a5f98ba1e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9eae10f-8ed1-4e50-8ae7-8a5f98ba1e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb878c2-abf2-421c-9efb-5dcc9943c763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb878c2-abf2-421c-9efb-5dcc9943c763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23d1a037-9b75-4ae4-bfc5-478ee15f0f40', 'volume_name': 'volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3353646-278a-46e7-94b9-3270ceaa0721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3353646-278a-46e7-94b9-3270ceaa0721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a850811e-ee5b-423c-9d87-6bd802611a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:37 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Volume 23d1a037-9b75-4ae4-bfc5-478ee15f0f40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40', 'volume_size': 1} Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:37 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e7e706c9-ae76-4f73-82bd-ebdcf1729c67 tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-f0f6caeb-870b-48f6-9f78-f4bedef7e954" returned: 0 in 0.448s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e7e706c9-ae76-4f73-82bd-ebdcf1729c67 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-quobyte-f0f6caeb-870b-48f6-9f78-f4bedef7e954" released by "delete_volume" :: held 1.019s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-e7e706c9-ae76-4f73-82bd-ebdcf1729c67 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Created reservations ['ea331ebf-6055-4140-8729-a19adc328948', 'f6057e72-22a6-46d7-81ed-a2580aa1ca93', '0f53f276-810e-4bbb-950f-5fc3d3726b5d', '939b8d36-1243-4602-bbf8-8841d71ae502'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e7e706c9-ae76-4f73-82bd-ebdcf1729c67 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e7e706c9-ae76-4f73-82bd-ebdcf1729c67 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e7e706c9-ae76-4f73-82bd-ebdcf1729c67 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-e7e706c9-ae76-4f73-82bd-ebdcf1729c67 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-e7e706c9-ae76-4f73-82bd-ebdcf1729c67 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e7e706c9-ae76-4f73-82bd-ebdcf1729c67 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:37 devstack sudo[90431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:50:37 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:37 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-67713881-18d0-4ce3-85ca-da94455a75fd tempest-SnapshotDependencyTests-1674598386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c31a9628-58a1-471a-a624-ee3d176ac87b -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.36f1d54b-06ba-4170-8b67-7a8e72be9666" returned: 0 in 0.470s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:37 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-67713881-18d0-4ce3-85ca-da94455a75fd tempest-SnapshotDependencyTests-1674598386 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.36f1d54b-06ba-4170-8b67-7a8e72be9666 is being set with open permissions: ugo+rw Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-67713881-18d0-4ce3-85ca-da94455a75fd tempest-SnapshotDependencyTests-1674598386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.36f1d54b-06ba-4170-8b67-7a8e72be9666 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:37 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.36f1d54b-06ba-4170-8b67-7a8e72be9666 Apr 16 19:50:37 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:37 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e7e706c9-ae76-4f73-82bd-ebdcf1729c67 tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.429s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-e7e706c9-ae76-4f73-82bd-ebdcf1729c67 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:50:37 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-e7e706c9-ae76-4f73-82bd-ebdcf1729c67 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Deleted volume successfully. Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG dbcounter [-] [82569] Writing DB stats cinder:UPDATE=177,cinder:SELECT=136,cinder:INSERT=38,cinder:DELETE=18 {{(pid=82569) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e7e706c9-ae76-4f73-82bd-ebdcf1729c67 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-f0f6caeb-870b-48f6-9f78-f4bedef7e954-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:37 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-67713881-18d0-4ce3-85ca-da94455a75fd tempest-SnapshotDependencyTests-1674598386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.36f1d54b-06ba-4170-8b67-7a8e72be9666" returned: 0 in 0.427s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG dbcounter [-] [82569] Writing DB stats cinder:SELECT=132,cinder:UPDATE=208,cinder:INSERT=48,cinder:DELETE=20 {{(pid=82569) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:50:37 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-67713881-18d0-4ce3-85ca-da94455a75fd tempest-SnapshotDependencyTests-1674598386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:37 devstack sudo[90437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.info Apr 16 19:50:37 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:38 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-67713881-18d0-4ce3-85ca-da94455a75fd tempest-SnapshotDependencyTests-1674598386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.info" returned: 0 in 0.418s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:38 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-67713881-18d0-4ce3-85ca-da94455a75fd tempest-SnapshotDependencyTests-1674598386 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.info is being set with open permissions: ugo+rw Apr 16 19:50:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-67713881-18d0-4ce3-85ca-da94455a75fd tempest-SnapshotDependencyTests-1674598386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:38 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.info Apr 16 19:50:38 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:38 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-24c9bd88-ae52-48c2-9e17-2e9b9403ffa8 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "cinder-15de910b-7872-4ee2-b50c-dd8e7f68a931-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:38 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-24c9bd88-ae52-48c2-9e17-2e9b9403ffa8 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-15de910b-7872-4ee2-b50c-dd8e7f68a931-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:38 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-24c9bd88-ae52-48c2-9e17-2e9b9403ffa8 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "cinder-quobyte-15de910b-7872-4ee2-b50c-dd8e7f68a931" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:38 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-24c9bd88-ae52-48c2-9e17-2e9b9403ffa8 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-quobyte-15de910b-7872-4ee2-b50c-dd8e7f68a931" acquired by "delete_volume" :: waited 0.007s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:38 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[79074c3d-af11-458e-9019-750c33cb7901]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-24c9bd88-ae52-48c2-9e17-2e9b9403ffa8 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-15de910b-7872-4ee2-b50c-dd8e7f68a931 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:38 devstack sudo[90442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-15de910b-7872-4ee2-b50c-dd8e7f68a931 Apr 16 19:50:38 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:38 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-67713881-18d0-4ce3-85ca-da94455a75fd tempest-SnapshotDependencyTests-1674598386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.info" returned: 0 in 0.431s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-67713881-18d0-4ce3-85ca-da94455a75fd tempest-SnapshotDependencyTests-1674598386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.878s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.790s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:38 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1792652962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e7afa66-7505-4385-b06c-7047cbe8b4d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55701d1c82e40a598769214a003be30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:35Z,use_quota=True,user_id='93e3aa68523b478e8228dc3dcaa7afcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:50:38 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Creating volume 0e7afa66-7505-4385-b06c-7047cbe8b4d1 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:50:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:38 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:38 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:38 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:50:38 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:50:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:38 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1 1073741824 Apr 16 19:50:38 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:38 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-67713881-18d0-4ce3-85ca-da94455a75fd tempest-SnapshotDependencyTests-1674598386 None] Create snapshot completed successfully Apr 16 19:50:38 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-24c9bd88-ae52-48c2-9e17-2e9b9403ffa8 tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-15de910b-7872-4ee2-b50c-dd8e7f68a931" returned: 0 in 0.501s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:38 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-24c9bd88-ae52-48c2-9e17-2e9b9403ffa8 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-15de910b-7872-4ee2-b50c-dd8e7f68a931 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:38 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-15de910b-7872-4ee2-b50c-dd8e7f68a931 Apr 16 19:50:38 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Flow 'volume_create_manager' (02fd36c0-442b-42a2-8ff1-349255d915e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b1b117-e65b-4d10-b05b-1d93fcffa8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b1b117-e65b-4d10-b05b-1d93fcffa8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff952cd-b096-4469-857c-3dd05a48c939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='632f9af2863d4ac39c086d190222e685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=36f1d54b-06ba-4170-8b67-7a8e72be9666,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:39Z,use_quota=True,user_id='f0b12fb2e1a54c3492d0840a1737f800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96752b12-8008-4ce2-b435-20097af7c1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96752b12-8008-4ce2-b435-20097af7c1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617e3837-8ff3-4c30-8f68-8fa2f5c781ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617e3837-8ff3-4c30-8f68-8fa2f5c781ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3ff952cd-b096-4469-857c-3dd05a48c939', 'volume_name': 'volume-3ff952cd-b096-4469-857c-3dd05a48c939', 'volume_size': 1, 'snapshot_id': '36f1d54b-06ba-4170-8b67-7a8e72be9666'}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad52fe00-f711-46c6-9247-8e24b7616dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad52fe00-f711-46c6-9247-8e24b7616dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cfc8bec-53bb-419f-be6d-f4e0007fd989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:39 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Volume 3ff952cd-b096-4469-857c-3dd05a48c939: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3ff952cd-b096-4469-857c-3dd05a48c939', 'volume_size': 1, 'snapshot_id': '36f1d54b-06ba-4170-8b67-7a8e72be9666'} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:39 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1 1073741824" returned: 0 in 0.586s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:39 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1 Apr 16 19:50:39 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:39 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-24c9bd88-ae52-48c2-9e17-2e9b9403ffa8 tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-15de910b-7872-4ee2-b50c-dd8e7f68a931" returned: 0 in 0.465s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-24c9bd88-ae52-48c2-9e17-2e9b9403ffa8 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-quobyte-15de910b-7872-4ee2-b50c-dd8e7f68a931" released by "delete_volume" :: held 0.989s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-24c9bd88-ae52-48c2-9e17-2e9b9403ffa8 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Created reservations ['10906b0b-8c88-44c6-8b5c-a15e09bca86c', '35f5f442-4297-44e5-b47f-c75690294202', '119a1579-88f9-4402-a53c-a16383429d97', 'd6c28cf9-3258-4198-8518-4abf006f1100'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-24c9bd88-ae52-48c2-9e17-2e9b9403ffa8 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-24c9bd88-ae52-48c2-9e17-2e9b9403ffa8 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-24c9bd88-ae52-48c2-9e17-2e9b9403ffa8 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-24c9bd88-ae52-48c2-9e17-2e9b9403ffa8 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-24c9bd88-ae52-48c2-9e17-2e9b9403ffa8 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-24c9bd88-ae52-48c2-9e17-2e9b9403ffa8 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:39 devstack sudo[90458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:50:39 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:39 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1" returned: 0 in 0.432s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.635s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2063078089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d1a037-9b75-4ae4-bfc5-478ee15f0f40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7276a2a89b4e43a384248b6961cd0e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:37Z,use_quota=True,user_id='bab1390cea094685b31a52d9b907d421',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Creating volume 23d1a037-9b75-4ae4-bfc5-478ee15f0f40 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:50:39 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (281a3348-850e-4f3b-87c4-cc43302d6104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:39 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40 1073741824 Apr 16 19:50:39 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f931fc07-ec23-4c26-9524-8f4827ce9349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:39 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Volume volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1 (0e7afa66-7505-4385-b06c-7047cbe8b4d1): created successfully Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f931fc07-ec23-4c26-9524-8f4827ce9349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Flow 'volume_create_manager' (0943be06-56ad-4a12-9ff2-ce557d3d0326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:39 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-653f1d12-08c1-458d-bf17-418886246b1e tempest-VolumeDependencyTests-669614506 None] Created volume successfully. Apr 16 19:50:39 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-24c9bd88-ae52-48c2-9e17-2e9b9403ffa8 tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.420s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-24c9bd88-ae52-48c2-9e17-2e9b9403ffa8 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:50:39 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-24c9bd88-ae52-48c2-9e17-2e9b9403ffa8 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Deleted volume successfully. Apr 16 19:50:39 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-24c9bd88-ae52-48c2-9e17-2e9b9403ffa8 tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-15de910b-7872-4ee2-b50c-dd8e7f68a931-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:40 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40 1073741824" returned: 0 in 0.556s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:50:40 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40 Apr 16 19:50:40 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Flow 'volume_create_manager' (24e7aac6-7615-40d4-a525-c668bb4237d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eddbbd3-86e3-4324-b83d-30a7cf31302c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eddbbd3-86e3-4324-b83d-30a7cf31302c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1833406246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76faddbc-ba7d-4337-adac-dcf368c1bbd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55701d1c82e40a598769214a003be30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0e7afa66-7505-4385-b06c-7047cbe8b4d1,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:40Z,use_quota=True,user_id='93e3aa68523b478e8228dc3dcaa7afcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356d0438-606c-41e3-b35f-b266a59d7bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356d0438-606c-41e3-b35f-b266a59d7bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a333227c-c8de-426f-93d8-94f75b6d8ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a333227c-c8de-426f-93d8-94f75b6d8ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '76faddbc-ba7d-4337-adac-dcf368c1bbd4', 'volume_name': 'volume-76faddbc-ba7d-4337-adac-dcf368c1bbd4', 'volume_size': 1, 'source_volid': '0e7afa66-7505-4385-b06c-7047cbe8b4d1', 'source_volstatus': 'available'}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cbe6cd2-57b5-4a2d-beb2-752d0504f2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cbe6cd2-57b5-4a2d-beb2-752d0504f2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a4b92d-5be4-4a0c-a9f6-6a0d4405aa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:40 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Volume 76faddbc-ba7d-4337-adac-dcf368c1bbd4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-76faddbc-ba7d-4337-adac-dcf368c1bbd4', 'volume_size': 1, 'source_volid': '0e7afa66-7505-4385-b06c-7047cbe8b4d1', 'source_volstatus': 'available'} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-dad75364-e85b-45d9-8697-e312e82ec08d tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "cinder-d02c83a8-9629-461b-81d7-8719979bc746-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-dad75364-e85b-45d9-8697-e312e82ec08d tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-d02c83a8-9629-461b-81d7-8719979bc746-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-dad75364-e85b-45d9-8697-e312e82ec08d tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "cinder-quobyte-d02c83a8-9629-461b-81d7-8719979bc746" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-dad75364-e85b-45d9-8697-e312e82ec08d tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-quobyte-d02c83a8-9629-461b-81d7-8719979bc746" acquired by "delete_volume" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[a667df66-1694-4977-8388-ef678e83ec84]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-dad75364-e85b-45d9-8697-e312e82ec08d tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d02c83a8-9629-461b-81d7-8719979bc746 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:40 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d02c83a8-9629-461b-81d7-8719979bc746 Apr 16 19:50:40 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:40 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40" returned: 0 in 0.434s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.512s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Acquiring lock "cinder-quobyte-36f1d54b-06ba-4170-8b67-7a8e72be9666-3ff952cd-b096-4469-857c-3dd05a48c939" by "_create_volume_from_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a850811e-ee5b-423c-9d87-6bd802611a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba75dc51-9514-48b3-8984-3362d9de1516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Lock "cinder-quobyte-36f1d54b-06ba-4170-8b67-7a8e72be9666-3ff952cd-b096-4469-857c-3dd05a48c939" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Creating volume 3ff952cd-b096-4469-857c-3dd05a48c939 from snapshot 36f1d54b-06ba-4170-8b67-7a8e72be9666 {{(pid=82569) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Acquiring lock "cinder-quobyte-3ff952cd-b096-4469-857c-3dd05a48c939" by "_copy_volume_from_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:40 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Volume volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40 (23d1a037-9b75-4ae4-bfc5-478ee15f0f40): created successfully Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba75dc51-9514-48b3-8984-3362d9de1516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Flow 'volume_create_manager' (61429654-cd17-47e8-81cf-99af37520d1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Lock "cinder-quobyte-3ff952cd-b096-4469-857c-3dd05a48c939" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] snapshot: 36f1d54b-06ba-4170-8b67-7a8e72be9666, volume: 3ff952cd-b096-4469-857c-3dd05a48c939, {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 19:50:40 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-7c0bbd02-48c5-45ba-b44f-a216b4aa0629 tempest-CinderUnicodeTest-380732806 None] Created volume successfully. Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d7a9f9-5b1f-4a1a-bcb1-3fbd91b22a62]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:40 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.36f1d54b-06ba-4170-8b67-7a8e72be9666 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:40 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.36f1d54b-06ba-4170-8b67-7a8e72be9666 Apr 16 19:50:40 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:41 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-dad75364-e85b-45d9-8697-e312e82ec08d tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d02c83a8-9629-461b-81d7-8719979bc746" returned: 0 in 0.453s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-dad75364-e85b-45d9-8697-e312e82ec08d tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d02c83a8-9629-461b-81d7-8719979bc746 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:41 devstack sudo[90477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d02c83a8-9629-461b-81d7-8719979bc746 Apr 16 19:50:41 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:41 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.36f1d54b-06ba-4170-8b67-7a8e72be9666" returned: 0 in 0.539s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:41 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c31a9628-58a1-471a-a624-ee3d176ac87b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:50:41 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 19:50:41 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Creating direct copy from snapshot {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 19:50:41 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db0e952-c85a-4f78-a81a-81f726048e69]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7ae95349-2393-4289-b4a9-ee7296946fd4 tempest-CinderUnicodeTest-380732806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:41 devstack sudo[90482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b Apr 16 19:50:41 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:41 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-dad75364-e85b-45d9-8697-e312e82ec08d tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-d02c83a8-9629-461b-81d7-8719979bc746" returned: 0 in 0.490s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:41 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-dad75364-e85b-45d9-8697-e312e82ec08d tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-quobyte-d02c83a8-9629-461b-81d7-8719979bc746" released by "delete_volume" :: held 0.974s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:41 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-dad75364-e85b-45d9-8697-e312e82ec08d tempest-CreateVolumesFromSnapshotTest-1828106995 None] Created reservations ['772c6f45-5767-4cbb-8f1d-3b2d5a45c739', '16725777-1304-4251-aa08-1c4a448760f9', '065a9f47-a247-4dc0-9e72-8f6d0f4fd4bc', '36015910-ee1f-429b-afb1-c45f74bc8003'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:50:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-dad75364-e85b-45d9-8697-e312e82ec08d tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-dad75364-e85b-45d9-8697-e312e82ec08d tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:41 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-dad75364-e85b-45d9-8697-e312e82ec08d tempest-CreateVolumesFromSnapshotTest-1828106995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:41 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-dad75364-e85b-45d9-8697-e312e82ec08d tempest-CreateVolumesFromSnapshotTest-1828106995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-dad75364-e85b-45d9-8697-e312e82ec08d tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-dad75364-e85b-45d9-8697-e312e82ec08d tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:41 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:50:41 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:41 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-78d727c3-5e6c-44d8-af6c-304789a888af tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "cinder-15436e68-1a08-4b2b-8e19-3a831243b4d0-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:41 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-78d727c3-5e6c-44d8-af6c-304789a888af tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-15436e68-1a08-4b2b-8e19-3a831243b4d0-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:41 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-78d727c3-5e6c-44d8-af6c-304789a888af tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "cinder-quobyte-15436e68-1a08-4b2b-8e19-3a831243b4d0" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:41 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-78d727c3-5e6c-44d8-af6c-304789a888af tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-quobyte-15436e68-1a08-4b2b-8e19-3a831243b4d0" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:41 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd9a43b-d406-47a5-821a-93879fa8eda4]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-78d727c3-5e6c-44d8-af6c-304789a888af tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-15436e68-1a08-4b2b-8e19-3a831243b4d0 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:41 devstack sudo[90487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-15436e68-1a08-4b2b-8e19-3a831243b4d0 Apr 16 19:50:41 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:41 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b" returned: 0 in 0.520s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:41 devstack cinder-volume[82569]: DEBUG cinder.utils [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Path /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3ff952cd-b096-4469-857c-3dd05a48c939 not found in is_blk_device check {{(pid=82569) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 19:50:41 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3ff952cd-b096-4469-857c-3dd05a48c939 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:41 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3ff952cd-b096-4469-857c-3dd05a48c939 Apr 16 19:50:41 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:42 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-dad75364-e85b-45d9-8697-e312e82ec08d tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.423s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:42 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-dad75364-e85b-45d9-8697-e312e82ec08d tempest-CreateVolumesFromSnapshotTest-1828106995 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:50:42 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-dad75364-e85b-45d9-8697-e312e82ec08d tempest-CreateVolumesFromSnapshotTest-1828106995 None] Deleted volume successfully. Apr 16 19:50:42 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-dad75364-e85b-45d9-8697-e312e82ec08d tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-d02c83a8-9629-461b-81d7-8719979bc746-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:42 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-78d727c3-5e6c-44d8-af6c-304789a888af tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-15436e68-1a08-4b2b-8e19-3a831243b4d0" returned: 0 in 0.475s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-78d727c3-5e6c-44d8-af6c-304789a888af tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-15436e68-1a08-4b2b-8e19-3a831243b4d0 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:42 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-15436e68-1a08-4b2b-8e19-3a831243b4d0 Apr 16 19:50:42 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:42 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:42 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-78d727c3-5e6c-44d8-af6c-304789a888af tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-15436e68-1a08-4b2b-8e19-3a831243b4d0" returned: 0 in 0.830s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-78d727c3-5e6c-44d8-af6c-304789a888af tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-quobyte-15436e68-1a08-4b2b-8e19-3a831243b4d0" released by "delete_volume" :: held 1.331s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:43 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-78d727c3-5e6c-44d8-af6c-304789a888af tempest-CreateVolumesFromSnapshotTest-1828106995 None] Created reservations ['2cf0ccc0-e66a-4059-b1b5-41f70b14253e', 'e7955884-6b40-46d5-bde2-d2603a728cce', 'bb4016e9-1df2-467b-8085-2882fec02bf4', '3643cdd3-743f-48d1-b549-da86090cb3fe'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:50:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-78d727c3-5e6c-44d8-af6c-304789a888af tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-78d727c3-5e6c-44d8-af6c-304789a888af tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:43 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-78d727c3-5e6c-44d8-af6c-304789a888af tempest-CreateVolumesFromSnapshotTest-1828106995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:43 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-78d727c3-5e6c-44d8-af6c-304789a888af tempest-CreateVolumesFromSnapshotTest-1828106995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-78d727c3-5e6c-44d8-af6c-304789a888af tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-78d727c3-5e6c-44d8-af6c-304789a888af tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:43 devstack sudo[90511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:50:43 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-299fef88-c943-461e-8f95-46ad6518bdfe tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "cinder-8bce2df8-6da9-461a-9ed6-204b2745e657-delete_snapshot" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-299fef88-c943-461e-8f95-46ad6518bdfe tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-8bce2df8-6da9-461a-9ed6-204b2745e657-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-299fef88-c943-461e-8f95-46ad6518bdfe tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "cinder-quobyte-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-299fef88-c943-461e-8f95-46ad6518bdfe tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-quobyte-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-299fef88-c943-461e-8f95-46ad6518bdfe tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "cinder-quobyte-8bce2df8-6da9-461a-9ed6-204b2745e657" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:43 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-299fef88-c943-461e-8f95-46ad6518bdfe tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-quobyte-8bce2df8-6da9-461a-9ed6-204b2745e657" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:43 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-299fef88-c943-461e-8f95-46ad6518bdfe tempest-CreateVolumesFromSnapshotTest-1828106995 None] Deleting offline snapshot 8bce2df8-6da9-461a-9ed6-204b2745e657 of volume 0a9cfdd6-f814-4287-aed0-f5f3e0dcd986 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:50:43 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-299fef88-c943-461e-8f95-46ad6518bdfe tempest-CreateVolumesFromSnapshotTest-1828106995 None] snapshot_file for this snap is: volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986.8bce2df8-6da9-461a-9ed6-204b2745e657 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:50:43 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[441517de-449b-40c0-aeac-b8501b9d0bd9]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-299fef88-c943-461e-8f95-46ad6518bdfe tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986.8bce2df8-6da9-461a-9ed6-204b2745e657 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:43 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3ff952cd-b096-4469-857c-3dd05a48c939" returned: 0 in 2.107s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:43 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f826b57-845b-4087-8ca7-5c05b3a1ab9d]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:43 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:44 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-78d727c3-5e6c-44d8-af6c-304789a888af tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.896s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:44 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-78d727c3-5e6c-44d8-af6c-304789a888af tempest-CreateVolumesFromSnapshotTest-1828106995 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:50:44 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-78d727c3-5e6c-44d8-af6c-304789a888af tempest-CreateVolumesFromSnapshotTest-1828106995 None] Deleted volume successfully. Apr 16 19:50:44 devstack sudo[90515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986.8bce2df8-6da9-461a-9ed6-204b2745e657 Apr 16 19:50:44 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:44 devstack sudo[90516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b Apr 16 19:50:44 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:44 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-78d727c3-5e6c-44d8-af6c-304789a888af tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-15436e68-1a08-4b2b-8e19-3a831243b4d0-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:44 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-299fef88-c943-461e-8f95-46ad6518bdfe tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986.8bce2df8-6da9-461a-9ed6-204b2745e657" returned: 0 in 0.530s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:44 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-299fef88-c943-461e-8f95-46ad6518bdfe tempest-CreateVolumesFromSnapshotTest-1828106995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:50:44 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb84eff8-acd4-4b4b-b789-eaf0897adae4]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-299fef88-c943-461e-8f95-46ad6518bdfe tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:44 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b" returned: 0 in 0.596s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:44 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Image conversion details: src /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b, size 1024.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3ff952cd-b096-4469-857c-3dd05a48c939 {{(pid=82569) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 19:50:44 devstack cinder-volume[82569]: INFO cinder.image.image_utils [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Converted 1024.00 MB image at 485.45 MB/s Apr 16 19:50:44 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3ff952cd-b096-4469-857c-3dd05a48c939 is being set with open permissions: ugo+rw Apr 16 19:50:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3ff952cd-b096-4469-857c-3dd05a48c939 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:44 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3ff952cd-b096-4469-857c-3dd05a48c939 Apr 16 19:50:44 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:44 devstack sudo[90525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986 Apr 16 19:50:44 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:44 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:44 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3ff952cd-b096-4469-857c-3dd05a48c939" returned: 0 in 0.402s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:45 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Lock "cinder-quobyte-3ff952cd-b096-4469-857c-3dd05a48c939" released by "_copy_volume_from_snapshot" :: held 4.230s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:45 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Lock "cinder-quobyte-36f1d54b-06ba-4170-8b67-7a8e72be9666-3ff952cd-b096-4469-857c-3dd05a48c939" released by "_create_volume_from_snapshot" :: held 4.260s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.285s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.618s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:45 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Cloning volume 0e7afa66-7505-4385-b06c-7047cbe8b4d1 to volume 76faddbc-ba7d-4337-adac-dcf368c1bbd4 Apr 16 19:50:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cfc8bec-53bb-419f-be6d-f4e0007fd989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ff952cd-b096-4469-857c-3dd05a48c939', 'volume_size': 1, 'snapshot_id': '36f1d54b-06ba-4170-8b67-7a8e72be9666'}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a45d45e1-60db-4469-9410-783bedcbbc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:45 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Creating offline snapshot 54165b74-487d-41ca-acb3-259c0500eed1 of volume 0e7afa66-7505-4385-b06c-7047cbe8b4d1 {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:50:45 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Volume volume-3ff952cd-b096-4469-857c-3dd05a48c939 (3ff952cd-b096-4469-857c-3dd05a48c939): created successfully Apr 16 19:50:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a45d45e1-60db-4469-9410-783bedcbbc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:45 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Flow 'volume_create_manager' (02fd36c0-442b-42a2-8ff1-349255d915e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:45 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[c790de6c-b4fe-4f02-97c8-290278936aa7]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:45 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-ce229ccc-5d5b-4a6b-9a24-0fa58337927b tempest-SnapshotDependencyTests-1674598386 None] Created volume successfully. Apr 16 19:50:45 devstack sudo[90533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1 Apr 16 19:50:45 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:45 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-299fef88-c943-461e-8f95-46ad6518bdfe tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986" returned: 0 in 0.620s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-299fef88-c943-461e-8f95-46ad6518bdfe tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986.8bce2df8-6da9-461a-9ed6-204b2745e657 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:45 devstack sudo[90535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986.8bce2df8-6da9-461a-9ed6-204b2745e657 Apr 16 19:50:45 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:45 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-299fef88-c943-461e-8f95-46ad6518bdfe tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986.8bce2df8-6da9-461a-9ed6-204b2745e657" returned: 0 in 0.454s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-299fef88-c943-461e-8f95-46ad6518bdfe tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986.8bce2df8-6da9-461a-9ed6-204b2745e657 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:45 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1" returned: 0 in 0.551s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.54165b74-487d-41ca-acb3-259c0500eed1 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:45 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986.8bce2df8-6da9-461a-9ed6-204b2745e657 Apr 16 19:50:45 devstack sudo[90544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.54165b74-487d-41ca-acb3-259c0500eed1 1G Apr 16 19:50:45 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:45 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:45 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-53c20f42-dfa5-49e9-9fed-9a0437075b45 tempest-SnapshotDependencyTests-1674598386 None] Acquiring lock "cinder-36f1d54b-06ba-4170-8b67-7a8e72be9666-delete_snapshot" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:45 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-53c20f42-dfa5-49e9-9fed-9a0437075b45 tempest-SnapshotDependencyTests-1674598386 None] Lock "cinder-36f1d54b-06ba-4170-8b67-7a8e72be9666-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:45 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-53c20f42-dfa5-49e9-9fed-9a0437075b45 tempest-SnapshotDependencyTests-1674598386 None] Acquiring lock "cinder-quobyte-c31a9628-58a1-471a-a624-ee3d176ac87b" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:45 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-53c20f42-dfa5-49e9-9fed-9a0437075b45 tempest-SnapshotDependencyTests-1674598386 None] Lock "cinder-quobyte-c31a9628-58a1-471a-a624-ee3d176ac87b" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:45 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-53c20f42-dfa5-49e9-9fed-9a0437075b45 tempest-SnapshotDependencyTests-1674598386 None] Acquiring lock "cinder-quobyte-36f1d54b-06ba-4170-8b67-7a8e72be9666" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:45 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-53c20f42-dfa5-49e9-9fed-9a0437075b45 tempest-SnapshotDependencyTests-1674598386 None] Lock "cinder-quobyte-36f1d54b-06ba-4170-8b67-7a8e72be9666" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:45 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-53c20f42-dfa5-49e9-9fed-9a0437075b45 tempest-SnapshotDependencyTests-1674598386 None] Deleting offline snapshot 36f1d54b-06ba-4170-8b67-7a8e72be9666 of volume c31a9628-58a1-471a-a624-ee3d176ac87b {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:50:45 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-53c20f42-dfa5-49e9-9fed-9a0437075b45 tempest-SnapshotDependencyTests-1674598386 None] snapshot_file for this snap is: volume-c31a9628-58a1-471a-a624-ee3d176ac87b.36f1d54b-06ba-4170-8b67-7a8e72be9666 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:50:45 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5758ab8-4ef3-49ab-8e93-bd8eb2533f1f]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:45 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-53c20f42-dfa5-49e9-9fed-9a0437075b45 tempest-SnapshotDependencyTests-1674598386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.36f1d54b-06ba-4170-8b67-7a8e72be9666 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:45 devstack sudo[90547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.36f1d54b-06ba-4170-8b67-7a8e72be9666 Apr 16 19:50:45 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:46 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-299fef88-c943-461e-8f95-46ad6518bdfe tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986.8bce2df8-6da9-461a-9ed6-204b2745e657" returned: 0 in 0.454s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:46 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-299fef88-c943-461e-8f95-46ad6518bdfe tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-quobyte-8bce2df8-6da9-461a-9ed6-204b2745e657" released by "_delete_snapshot" :: held 2.124s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:46 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-299fef88-c943-461e-8f95-46ad6518bdfe tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-quobyte-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986" released by "delete_snapshot" :: held 2.139s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:46 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.54165b74-487d-41ca-acb3-259c0500eed1 1G" returned: 0 in 0.480s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.54165b74-487d-41ca-acb3-259c0500eed1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:46 devstack sudo[90553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.54165b74-487d-41ca-acb3-259c0500eed1 Apr 16 19:50:46 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:46 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-299fef88-c943-461e-8f95-46ad6518bdfe tempest-CreateVolumesFromSnapshotTest-1828106995 None] Created reservations ['f6b23e68-96bb-46f8-8861-c81ddfe3ab84', 'afe7ace9-85ad-421c-a164-f6363d5a5ee9', '3db8b9de-f7f8-418a-9e7d-50ca74d0313f', '7ec3927b-2719-4ead-8236-b86613847379'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:50:46 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-299fef88-c943-461e-8f95-46ad6518bdfe tempest-CreateVolumesFromSnapshotTest-1828106995 None] Delete snapshot completed successfully. Apr 16 19:50:46 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-299fef88-c943-461e-8f95-46ad6518bdfe tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-8bce2df8-6da9-461a-9ed6-204b2745e657-delete_snapshot" released by "delete_snapshot" :: held 2.240s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:46 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-53c20f42-dfa5-49e9-9fed-9a0437075b45 tempest-SnapshotDependencyTests-1674598386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.36f1d54b-06ba-4170-8b67-7a8e72be9666" returned: 0 in 0.502s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:46 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-53c20f42-dfa5-49e9-9fed-9a0437075b45 tempest-SnapshotDependencyTests-1674598386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c31a9628-58a1-471a-a624-ee3d176ac87b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:50:46 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eae00af-dca8-4653-b978-99edf96a20c8]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-53c20f42-dfa5-49e9-9fed-9a0437075b45 tempest-SnapshotDependencyTests-1674598386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:46 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b Apr 16 19:50:46 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:46 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.54165b74-487d-41ca-acb3-259c0500eed1" returned: 0 in 0.435s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:46 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.54165b74-487d-41ca-acb3-259c0500eed1 is being set with open permissions: ugo+rw Apr 16 19:50:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.54165b74-487d-41ca-acb3-259c0500eed1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:46 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.54165b74-487d-41ca-acb3-259c0500eed1 Apr 16 19:50:46 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:46 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-53c20f42-dfa5-49e9-9fed-9a0437075b45 tempest-SnapshotDependencyTests-1674598386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b" returned: 0 in 0.495s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-53c20f42-dfa5-49e9-9fed-9a0437075b45 tempest-SnapshotDependencyTests-1674598386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.36f1d54b-06ba-4170-8b67-7a8e72be9666 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:46 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.36f1d54b-06ba-4170-8b67-7a8e72be9666 Apr 16 19:50:46 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:46 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.54165b74-487d-41ca-acb3-259c0500eed1" returned: 0 in 0.414s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:46 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:46 devstack sudo[90571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.info Apr 16 19:50:46 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-830ebf8b-9e80-4cb0-99e5-f95169568eab tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "cinder-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-830ebf8b-9e80-4cb0-99e5-f95169568eab tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-830ebf8b-9e80-4cb0-99e5-f95169568eab tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "cinder-quobyte-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-830ebf8b-9e80-4cb0-99e5-f95169568eab tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-quobyte-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[13299236-0efd-4ef9-a7a9-408263fa2d6c]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-830ebf8b-9e80-4cb0-99e5-f95169568eab tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:47 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:47 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986 Apr 16 19:50:47 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-53c20f42-dfa5-49e9-9fed-9a0437075b45 tempest-SnapshotDependencyTests-1674598386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.36f1d54b-06ba-4170-8b67-7a8e72be9666" returned: 0 in 0.480s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-53c20f42-dfa5-49e9-9fed-9a0437075b45 tempest-SnapshotDependencyTests-1674598386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.36f1d54b-06ba-4170-8b67-7a8e72be9666 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:47 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.36f1d54b-06ba-4170-8b67-7a8e72be9666 Apr 16 19:50:47 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:47 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.info" returned: 0 in 0.442s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:47 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.info is being set with open permissions: ugo+rw Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:47 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.info Apr 16 19:50:47 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:47 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-830ebf8b-9e80-4cb0-99e5-f95169568eab tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986" returned: 0 in 0.485s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-830ebf8b-9e80-4cb0-99e5-f95169568eab tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:47 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986 Apr 16 19:50:47 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:47 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-53c20f42-dfa5-49e9-9fed-9a0437075b45 tempest-SnapshotDependencyTests-1674598386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b.36f1d54b-06ba-4170-8b67-7a8e72be9666" returned: 0 in 0.445s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-53c20f42-dfa5-49e9-9fed-9a0437075b45 tempest-SnapshotDependencyTests-1674598386 None] Lock "cinder-quobyte-36f1d54b-06ba-4170-8b67-7a8e72be9666" released by "_delete_snapshot" :: held 1.983s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-53c20f42-dfa5-49e9-9fed-9a0437075b45 tempest-SnapshotDependencyTests-1674598386 None] Lock "cinder-quobyte-c31a9628-58a1-471a-a624-ee3d176ac87b" released by "delete_snapshot" :: held 1.996s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-53c20f42-dfa5-49e9-9fed-9a0437075b45 tempest-SnapshotDependencyTests-1674598386 None] Created reservations ['4f2dc71f-7d7c-434e-a536-c23cff193650', '54bcede1-4992-4bfd-a4c5-d9a7a3562621', 'd318078c-fb7a-49cb-8be2-ef04bec810ef', '1b970d56-a47f-40c8-84e4-d1920d2cb1fb'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:50:47 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-53c20f42-dfa5-49e9-9fed-9a0437075b45 tempest-SnapshotDependencyTests-1674598386 None] Delete snapshot completed successfully. Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-53c20f42-dfa5-49e9-9fed-9a0437075b45 tempest-SnapshotDependencyTests-1674598386 None] Lock "cinder-36f1d54b-06ba-4170-8b67-7a8e72be9666-delete_snapshot" released by "delete_snapshot" :: held 2.088s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:47 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.info" returned: 0 in 0.473s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Acquiring lock "cinder-quobyte-76faddbc-ba7d-4337-adac-dcf368c1bbd4" by "_copy_volume_from_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Lock "cinder-quobyte-76faddbc-ba7d-4337-adac-dcf368c1bbd4" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] snapshot: 54165b74-487d-41ca-acb3-259c0500eed1, volume: 76faddbc-ba7d-4337-adac-dcf368c1bbd4, {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce190a7-c6ae-4fc7-80b4-7289dd0c5ba0]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:47 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.54165b74-487d-41ca-acb3-259c0500eed1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:47 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.54165b74-487d-41ca-acb3-259c0500eed1 Apr 16 19:50:47 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:48 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-830ebf8b-9e80-4cb0-99e5-f95169568eab tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986" returned: 0 in 0.415s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-830ebf8b-9e80-4cb0-99e5-f95169568eab tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-quobyte-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986" released by "delete_volume" :: held 0.932s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:48 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-830ebf8b-9e80-4cb0-99e5-f95169568eab tempest-CreateVolumesFromSnapshotTest-1828106995 None] Created reservations ['572286dc-b324-4457-9748-f6c32b0966c2', '32e80bb7-a4df-4a91-8bbd-6fa4bb60b447', '8c8b8f38-f6e8-451a-8356-3daeae048252', 'd40c264a-d7c9-4928-b8bd-82e1ddbf2708'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:50:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-830ebf8b-9e80-4cb0-99e5-f95169568eab tempest-CreateVolumesFromSnapshotTest-1828106995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-830ebf8b-9e80-4cb0-99e5-f95169568eab tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-830ebf8b-9e80-4cb0-99e5-f95169568eab tempest-CreateVolumesFromSnapshotTest-1828106995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-830ebf8b-9e80-4cb0-99e5-f95169568eab tempest-CreateVolumesFromSnapshotTest-1828106995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-830ebf8b-9e80-4cb0-99e5-f95169568eab tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-830ebf8b-9e80-4cb0-99e5-f95169568eab tempest-CreateVolumesFromSnapshotTest-1828106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:48 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:50:48 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:48 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.54165b74-487d-41ca-acb3-259c0500eed1" returned: 0 in 0.510s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:50:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1 {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 19:50:48 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Creating direct copy from snapshot {{(pid=82569) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 19:50:48 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[28741184-575e-48f6-bebd-60ffa57986af]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:48 devstack sudo[90598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1 Apr 16 19:50:48 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:48 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-830ebf8b-9e80-4cb0-99e5-f95169568eab tempest-CreateVolumesFromSnapshotTest-1828106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.477s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:48 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-830ebf8b-9e80-4cb0-99e5-f95169568eab tempest-CreateVolumesFromSnapshotTest-1828106995 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:50:48 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-830ebf8b-9e80-4cb0-99e5-f95169568eab tempest-CreateVolumesFromSnapshotTest-1828106995 None] Deleted volume successfully. Apr 16 19:50:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-830ebf8b-9e80-4cb0-99e5-f95169568eab tempest-CreateVolumesFromSnapshotTest-1828106995 None] Lock "cinder-0a9cfdd6-f814-4287-aed0-f5f3e0dcd986-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bd80a683-c32e-41a5-ad3b-82cc152f67f6 tempest-SnapshotDependencyTests-1674598386 None] Acquiring lock "cinder-c31a9628-58a1-471a-a624-ee3d176ac87b-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bd80a683-c32e-41a5-ad3b-82cc152f67f6 tempest-SnapshotDependencyTests-1674598386 None] Lock "cinder-c31a9628-58a1-471a-a624-ee3d176ac87b-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bd80a683-c32e-41a5-ad3b-82cc152f67f6 tempest-SnapshotDependencyTests-1674598386 None] Acquiring lock "cinder-quobyte-c31a9628-58a1-471a-a624-ee3d176ac87b" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:48 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bd80a683-c32e-41a5-ad3b-82cc152f67f6 tempest-SnapshotDependencyTests-1674598386 None] Lock "cinder-quobyte-c31a9628-58a1-471a-a624-ee3d176ac87b" acquired by "delete_volume" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:48 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f51e197-44fc-4615-bbea-887c763ad027]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:48 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bd80a683-c32e-41a5-ad3b-82cc152f67f6 tempest-SnapshotDependencyTests-1674598386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:48 devstack sudo[90601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b Apr 16 19:50:48 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:49 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1" returned: 0 in 0.593s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:49 devstack cinder-volume[82569]: DEBUG cinder.utils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Path /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-76faddbc-ba7d-4337-adac-dcf368c1bbd4 not found in is_blk_device check {{(pid=82569) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 19:50:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-76faddbc-ba7d-4337-adac-dcf368c1bbd4 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:49 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-76faddbc-ba7d-4337-adac-dcf368c1bbd4 Apr 16 19:50:49 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:49 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bd80a683-c32e-41a5-ad3b-82cc152f67f6 tempest-SnapshotDependencyTests-1674598386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b" returned: 0 in 0.523s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:49 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bd80a683-c32e-41a5-ad3b-82cc152f67f6 tempest-SnapshotDependencyTests-1674598386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:49 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b Apr 16 19:50:49 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:50 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bd80a683-c32e-41a5-ad3b-82cc152f67f6 tempest-SnapshotDependencyTests-1674598386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c31a9628-58a1-471a-a624-ee3d176ac87b" returned: 0 in 1.168s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:50 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bd80a683-c32e-41a5-ad3b-82cc152f67f6 tempest-SnapshotDependencyTests-1674598386 None] Lock "cinder-quobyte-c31a9628-58a1-471a-a624-ee3d176ac87b" released by "delete_volume" :: held 1.749s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:50 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-bd80a683-c32e-41a5-ad3b-82cc152f67f6 tempest-SnapshotDependencyTests-1674598386 None] Created reservations ['1086df4f-3d25-4803-850c-ea631ca31ba4', '476ae55d-c8e6-4a6a-9e4e-e1fbb79397d2', '994b5e20-3e0c-4f87-9c55-74047a8c1d7b', '44ce71fc-4a2e-4f5e-8aae-1bca0d4d8e26'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:50:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bd80a683-c32e-41a5-ad3b-82cc152f67f6 tempest-SnapshotDependencyTests-1674598386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bd80a683-c32e-41a5-ad3b-82cc152f67f6 tempest-SnapshotDependencyTests-1674598386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bd80a683-c32e-41a5-ad3b-82cc152f67f6 tempest-SnapshotDependencyTests-1674598386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:50 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bd80a683-c32e-41a5-ad3b-82cc152f67f6 tempest-SnapshotDependencyTests-1674598386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bd80a683-c32e-41a5-ad3b-82cc152f67f6 tempest-SnapshotDependencyTests-1674598386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:50 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bd80a683-c32e-41a5-ad3b-82cc152f67f6 tempest-SnapshotDependencyTests-1674598386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:50 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:50:50 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:51 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-307b7cc0-a709-49a8-b8af-74c06284689a tempest-SnapshotDependencyTests-1674598386 None] Acquiring lock "cinder-3ff952cd-b096-4469-857c-3dd05a48c939-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:51 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-307b7cc0-a709-49a8-b8af-74c06284689a tempest-SnapshotDependencyTests-1674598386 None] Lock "cinder-3ff952cd-b096-4469-857c-3dd05a48c939-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:51 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-307b7cc0-a709-49a8-b8af-74c06284689a tempest-SnapshotDependencyTests-1674598386 None] Acquiring lock "cinder-quobyte-3ff952cd-b096-4469-857c-3dd05a48c939" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:51 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-307b7cc0-a709-49a8-b8af-74c06284689a tempest-SnapshotDependencyTests-1674598386 None] Lock "cinder-quobyte-3ff952cd-b096-4469-857c-3dd05a48c939" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:51 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-76faddbc-ba7d-4337-adac-dcf368c1bbd4" returned: 0 in 2.352s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:51 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae8777a-556f-4e46-af85-11f37ec3133f]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-307b7cc0-a709-49a8-b8af-74c06284689a tempest-SnapshotDependencyTests-1674598386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3ff952cd-b096-4469-857c-3dd05a48c939 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:51 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbbe463-1454-447d-8144-58d496a17a8a]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:51 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:50:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Flow 'volume_create_manager' (53a6ebae-bb1e-48e7-86ee-df8a2ac14b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:51 devstack sudo[90635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3ff952cd-b096-4469-857c-3dd05a48c939 Apr 16 19:50:51 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd82b34-2d69-4487-9bba-1740312359be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd82b34-2d69-4487-9bba-1740312359be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1633023635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1379292c103541459c405158e8e6d8f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:51Z,use_quota=True,user_id='7cd3a3a831bd4b7a99c940821bb07497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:51 devstack sudo[90636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1 Apr 16 19:50:51 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db80b3f8-bf06-46a3-b924-abc13306795b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db80b3f8-bf06-46a3-b924-abc13306795b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205d259b-0ea6-4023-8fb5-68bf1ad0a2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205d259b-0ea6-4023-8fb5-68bf1ad0a2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474', 'volume_name': 'volume-b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9614229a-00bd-4ac1-9733-e85393e67081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9614229a-00bd-4ac1-9733-e85393e67081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:51 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347c8fa5-6594-4bb7-aabc-2d938e5fe9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:51 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Volume b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474', 'volume_size': 1} Apr 16 19:50:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:51 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bd80a683-c32e-41a5-ad3b-82cc152f67f6 tempest-SnapshotDependencyTests-1674598386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.813s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:51 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-bd80a683-c32e-41a5-ad3b-82cc152f67f6 tempest-SnapshotDependencyTests-1674598386 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:50:51 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-bd80a683-c32e-41a5-ad3b-82cc152f67f6 tempest-SnapshotDependencyTests-1674598386 None] Deleted volume successfully. Apr 16 19:50:51 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bd80a683-c32e-41a5-ad3b-82cc152f67f6 tempest-SnapshotDependencyTests-1674598386 None] Lock "cinder-c31a9628-58a1-471a-a624-ee3d176ac87b-delete_volume" released by "delete_volume" :: held 2.811s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:51 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-307b7cc0-a709-49a8-b8af-74c06284689a tempest-SnapshotDependencyTests-1674598386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3ff952cd-b096-4469-857c-3dd05a48c939" returned: 0 in 0.519s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:51 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-307b7cc0-a709-49a8-b8af-74c06284689a tempest-SnapshotDependencyTests-1674598386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3ff952cd-b096-4469-857c-3dd05a48c939 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:51 devstack sudo[90645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3ff952cd-b096-4469-857c-3dd05a48c939 Apr 16 19:50:51 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:52 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1" returned: 0 in 0.670s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:52 devstack cinder-volume[82569]: DEBUG cinder.image.image_utils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Image conversion details: src /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1, size 1024.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-76faddbc-ba7d-4337-adac-dcf368c1bbd4 {{(pid=82569) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 19:50:52 devstack cinder-volume[82569]: INFO cinder.image.image_utils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Converted 1024.00 MB image at 435.11 MB/s Apr 16 19:50:52 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-76faddbc-ba7d-4337-adac-dcf368c1bbd4 is being set with open permissions: ugo+rw Apr 16 19:50:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-76faddbc-ba7d-4337-adac-dcf368c1bbd4 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:52 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-76faddbc-ba7d-4337-adac-dcf368c1bbd4 Apr 16 19:50:52 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:52 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-307b7cc0-a709-49a8-b8af-74c06284689a tempest-SnapshotDependencyTests-1674598386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-3ff952cd-b096-4469-857c-3dd05a48c939" returned: 0 in 0.445s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:52 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-307b7cc0-a709-49a8-b8af-74c06284689a tempest-SnapshotDependencyTests-1674598386 None] Lock "cinder-quobyte-3ff952cd-b096-4469-857c-3dd05a48c939" released by "delete_volume" :: held 1.025s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:52 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-307b7cc0-a709-49a8-b8af-74c06284689a tempest-SnapshotDependencyTests-1674598386 None] Created reservations ['4bfc99c1-32ca-49d6-99b0-868521bcce8c', '915082bc-b5e0-43e1-8a8d-2c95723f5457', '9e5d4b56-1628-4dc2-b298-0588c977e62c', '7036675e-7865-4878-bb03-d973aedf101e'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:50:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-307b7cc0-a709-49a8-b8af-74c06284689a tempest-SnapshotDependencyTests-1674598386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-307b7cc0-a709-49a8-b8af-74c06284689a tempest-SnapshotDependencyTests-1674598386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:52 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-307b7cc0-a709-49a8-b8af-74c06284689a tempest-SnapshotDependencyTests-1674598386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:52 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-307b7cc0-a709-49a8-b8af-74c06284689a tempest-SnapshotDependencyTests-1674598386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-307b7cc0-a709-49a8-b8af-74c06284689a tempest-SnapshotDependencyTests-1674598386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-307b7cc0-a709-49a8-b8af-74c06284689a tempest-SnapshotDependencyTests-1674598386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:52 devstack sudo[90652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:50:52 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:52 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-76faddbc-ba7d-4337-adac-dcf368c1bbd4" returned: 0 in 0.469s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:52 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Lock "cinder-quobyte-76faddbc-ba7d-4337-adac-dcf368c1bbd4" released by "_copy_volume_from_snapshot" :: held 4.655s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:52 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Acquiring lock "cinder-quobyte-54165b74-487d-41ca-acb3-259c0500eed1" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:52 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Lock "cinder-quobyte-54165b74-487d-41ca-acb3-259c0500eed1" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:52 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Deleting offline snapshot 54165b74-487d-41ca-acb3-259c0500eed1 of volume 0e7afa66-7505-4385-b06c-7047cbe8b4d1 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:50:52 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] snapshot_file for this snap is: volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.54165b74-487d-41ca-acb3-259c0500eed1 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:50:52 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5f57cd-e7cc-4260-89fa-f615a5d8e4c0]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.54165b74-487d-41ca-acb3-259c0500eed1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:52 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.54165b74-487d-41ca-acb3-259c0500eed1 Apr 16 19:50:52 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:52 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:52 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-307b7cc0-a709-49a8-b8af-74c06284689a tempest-SnapshotDependencyTests-1674598386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.411s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:52 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-307b7cc0-a709-49a8-b8af-74c06284689a tempest-SnapshotDependencyTests-1674598386 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:50:52 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-307b7cc0-a709-49a8-b8af-74c06284689a tempest-SnapshotDependencyTests-1674598386 None] Deleted volume successfully. Apr 16 19:50:52 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-307b7cc0-a709-49a8-b8af-74c06284689a tempest-SnapshotDependencyTests-1674598386 None] Lock "cinder-3ff952cd-b096-4469-857c-3dd05a48c939-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:53 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.54165b74-487d-41ca-acb3-259c0500eed1" returned: 0 in 0.466s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:53 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:50:53 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[551b8782-5ab9-4620-b263-ad999ccbcc6a]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:53 devstack sudo[90660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1 Apr 16 19:50:53 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:53 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1" returned: 0 in 0.501s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:53 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.54165b74-487d-41ca-acb3-259c0500eed1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:53 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.54165b74-487d-41ca-acb3-259c0500eed1 Apr 16 19:50:53 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:54 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.54165b74-487d-41ca-acb3-259c0500eed1" returned: 0 in 0.495s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.54165b74-487d-41ca-acb3-259c0500eed1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:54 devstack sudo[90671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.54165b74-487d-41ca-acb3-259c0500eed1 Apr 16 19:50:54 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:54 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1.54165b74-487d-41ca-acb3-259c0500eed1" returned: 0 in 0.444s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:54 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Lock "cinder-quobyte-54165b74-487d-41ca-acb3-259c0500eed1" released by "_delete_snapshot" :: held 1.962s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.551s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7ae95349-2393-4289-b4a9-ee7296946fd4 tempest-CinderUnicodeTest-380732806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.163s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a4b92d-5be4-4a0c-a9f6-6a0d4405aa82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76faddbc-ba7d-4337-adac-dcf368c1bbd4', 'volume_size': 1, 'source_volid': '0e7afa66-7505-4385-b06c-7047cbe8b4d1', 'source_volstatus': 'available'}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c938f1c2-5c3a-42c3-9708-28c611adc8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:54 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-7ae95349-2393-4289-b4a9-ee7296946fd4 tempest-CinderUnicodeTest-380732806 None] Creating offline snapshot 38320b51-f9ce-49b8-8d06-f7a758f91729 of volume 23d1a037-9b75-4ae4-bfc5-478ee15f0f40 {{(pid=82569) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 19:50:54 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Volume volume-76faddbc-ba7d-4337-adac-dcf368c1bbd4 (76faddbc-ba7d-4337-adac-dcf368c1bbd4): created successfully Apr 16 19:50:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c938f1c2-5c3a-42c3-9708-28c611adc8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:54 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Flow 'volume_create_manager' (24e7aac6-7615-40d4-a525-c668bb4237d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:54 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fec3a00-a854-4bf7-a2fe-f5a96024e8bc]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:54 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7ae95349-2393-4289-b4a9-ee7296946fd4 tempest-CinderUnicodeTest-380732806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:54 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-04f98c06-2e63-4614-9885-a8619eeacc6a tempest-VolumeDependencyTests-669614506 None] Created volume successfully. Apr 16 19:50:54 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40 Apr 16 19:50:54 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:55 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7ae95349-2393-4289-b4a9-ee7296946fd4 tempest-CinderUnicodeTest-380732806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40" returned: 0 in 0.507s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7ae95349-2393-4289-b4a9-ee7296946fd4 tempest-CinderUnicodeTest-380732806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40.38320b51-f9ce-49b8-8d06-f7a758f91729 1G {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:55 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40.38320b51-f9ce-49b8-8d06-f7a758f91729 1G Apr 16 19:50:55 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:55 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-57a946db-f55a-4395-ab4c-18ecd2a544d3 tempest-VolumeDependencyTests-669614506 None] Acquiring lock "cinder-0e7afa66-7505-4385-b06c-7047cbe8b4d1-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:55 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-57a946db-f55a-4395-ab4c-18ecd2a544d3 tempest-VolumeDependencyTests-669614506 None] Lock "cinder-0e7afa66-7505-4385-b06c-7047cbe8b4d1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:55 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-57a946db-f55a-4395-ab4c-18ecd2a544d3 tempest-VolumeDependencyTests-669614506 None] Acquiring lock "cinder-quobyte-0e7afa66-7505-4385-b06c-7047cbe8b4d1" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:55 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-57a946db-f55a-4395-ab4c-18ecd2a544d3 tempest-VolumeDependencyTests-669614506 None] Lock "cinder-quobyte-0e7afa66-7505-4385-b06c-7047cbe8b4d1" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:55 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bfd677-3987-4fe5-b7a9-6abf1cdf702b]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-57a946db-f55a-4395-ab4c-18ecd2a544d3 tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:55 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1 Apr 16 19:50:55 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:55 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7ae95349-2393-4289-b4a9-ee7296946fd4 tempest-CinderUnicodeTest-380732806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40.38320b51-f9ce-49b8-8d06-f7a758f91729 1G" returned: 0 in 0.618s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:55 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7ae95349-2393-4289-b4a9-ee7296946fd4 tempest-CinderUnicodeTest-380732806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40.38320b51-f9ce-49b8-8d06-f7a758f91729 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:55 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40.38320b51-f9ce-49b8-8d06-f7a758f91729 Apr 16 19:50:55 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:56 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-57a946db-f55a-4395-ab4c-18ecd2a544d3 tempest-VolumeDependencyTests-669614506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1" returned: 0 in 0.579s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-57a946db-f55a-4395-ab4c-18ecd2a544d3 tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:56 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1 Apr 16 19:50:56 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:56 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7ae95349-2393-4289-b4a9-ee7296946fd4 tempest-CinderUnicodeTest-380732806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40 -F qcow2 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40.38320b51-f9ce-49b8-8d06-f7a758f91729" returned: 0 in 0.508s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:56 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-7ae95349-2393-4289-b4a9-ee7296946fd4 tempest-CinderUnicodeTest-380732806 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40.38320b51-f9ce-49b8-8d06-f7a758f91729 is being set with open permissions: ugo+rw Apr 16 19:50:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7ae95349-2393-4289-b4a9-ee7296946fd4 tempest-CinderUnicodeTest-380732806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40.38320b51-f9ce-49b8-8d06-f7a758f91729 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:56 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40.38320b51-f9ce-49b8-8d06-f7a758f91729 Apr 16 19:50:56 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:56 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-57a946db-f55a-4395-ab4c-18ecd2a544d3 tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-0e7afa66-7505-4385-b06c-7047cbe8b4d1" returned: 0 in 0.464s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:56 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-57a946db-f55a-4395-ab4c-18ecd2a544d3 tempest-VolumeDependencyTests-669614506 None] Lock "cinder-quobyte-0e7afa66-7505-4385-b06c-7047cbe8b4d1" released by "delete_volume" :: held 1.092s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:56 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-57a946db-f55a-4395-ab4c-18ecd2a544d3 tempest-VolumeDependencyTests-669614506 None] Created reservations ['7585e5a5-a47b-4afa-910f-b7f708d856a8', '66907134-434b-4622-be43-bbc99318d86a', '66cca7c6-1721-4cec-adf7-68ef48844b1f', '958ac4ca-c948-4522-a704-96cc01ae0763'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:50:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-57a946db-f55a-4395-ab4c-18ecd2a544d3 tempest-VolumeDependencyTests-669614506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-57a946db-f55a-4395-ab4c-18ecd2a544d3 tempest-VolumeDependencyTests-669614506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:56 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-57a946db-f55a-4395-ab4c-18ecd2a544d3 tempest-VolumeDependencyTests-669614506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:56 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-57a946db-f55a-4395-ab4c-18ecd2a544d3 tempest-VolumeDependencyTests-669614506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-57a946db-f55a-4395-ab4c-18ecd2a544d3 tempest-VolumeDependencyTests-669614506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-57a946db-f55a-4395-ab4c-18ecd2a544d3 tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:56 devstack sudo[90701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:50:56 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:56 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7ae95349-2393-4289-b4a9-ee7296946fd4 tempest-CinderUnicodeTest-380732806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40.38320b51-f9ce-49b8-8d06-f7a758f91729" returned: 0 in 0.521s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:56 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7ae95349-2393-4289-b4a9-ee7296946fd4 tempest-CinderUnicodeTest-380732806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:56 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40.info Apr 16 19:50:56 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:57 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-57a946db-f55a-4395-ab4c-18ecd2a544d3 tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.448s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:57 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-57a946db-f55a-4395-ab4c-18ecd2a544d3 tempest-VolumeDependencyTests-669614506 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:50:57 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-57a946db-f55a-4395-ab4c-18ecd2a544d3 tempest-VolumeDependencyTests-669614506 None] Deleted volume successfully. Apr 16 19:50:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-57a946db-f55a-4395-ab4c-18ecd2a544d3 tempest-VolumeDependencyTests-669614506 None] Lock "cinder-0e7afa66-7505-4385-b06c-7047cbe8b4d1-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:57 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7ae95349-2393-4289-b4a9-ee7296946fd4 tempest-CinderUnicodeTest-380732806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40.info" returned: 0 in 0.458s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:57 devstack cinder-volume[82569]: WARNING cinder.volume.drivers.remotefs [None req-7ae95349-2393-4289-b4a9-ee7296946fd4 tempest-CinderUnicodeTest-380732806 None] /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40.info is being set with open permissions: ugo+rw Apr 16 19:50:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7ae95349-2393-4289-b4a9-ee7296946fd4 tempest-CinderUnicodeTest-380732806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40.info {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:57 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40.info Apr 16 19:50:57 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3c615b98-3dbd-4069-a32b-3113d60067dc tempest-VolumeDependencyTests-669614506 None] Acquiring lock "cinder-76faddbc-ba7d-4337-adac-dcf368c1bbd4-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3c615b98-3dbd-4069-a32b-3113d60067dc tempest-VolumeDependencyTests-669614506 None] Lock "cinder-76faddbc-ba7d-4337-adac-dcf368c1bbd4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3c615b98-3dbd-4069-a32b-3113d60067dc tempest-VolumeDependencyTests-669614506 None] Acquiring lock "cinder-quobyte-76faddbc-ba7d-4337-adac-dcf368c1bbd4" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:57 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3c615b98-3dbd-4069-a32b-3113d60067dc tempest-VolumeDependencyTests-669614506 None] Lock "cinder-quobyte-76faddbc-ba7d-4337-adac-dcf368c1bbd4" acquired by "delete_volume" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:57 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5505e03-ba05-46e8-8905-c70d789a664c]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3c615b98-3dbd-4069-a32b-3113d60067dc tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-76faddbc-ba7d-4337-adac-dcf368c1bbd4 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:57 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-7ae95349-2393-4289-b4a9-ee7296946fd4 tempest-CinderUnicodeTest-380732806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40.info" returned: 0 in 0.505s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:57 devstack sudo[90712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-76faddbc-ba7d-4337-adac-dcf368c1bbd4 Apr 16 19:50:57 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-7ae95349-2393-4289-b4a9-ee7296946fd4 tempest-CinderUnicodeTest-380732806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.214s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.265s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:57 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1633023635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1379292c103541459c405158e8e6d8f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:50:51Z,use_quota=True,user_id='7cd3a3a831bd4b7a99c940821bb07497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:50:57 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Creating volume b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:50:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:57 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:57 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:57 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:50:57 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:50:57 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:57 devstack sudo[90714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474 1073741824 Apr 16 19:50:57 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:57 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-7ae95349-2393-4289-b4a9-ee7296946fd4 tempest-CinderUnicodeTest-380732806 None] Create snapshot completed successfully Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e3999433-2921-423e-82e5-f03536bb9baa tempest-CinderUnicodeTest-380732806 None] Acquiring lock "cinder-38320b51-f9ce-49b8-8d06-f7a758f91729-delete_snapshot" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e3999433-2921-423e-82e5-f03536bb9baa tempest-CinderUnicodeTest-380732806 None] Lock "cinder-38320b51-f9ce-49b8-8d06-f7a758f91729-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e3999433-2921-423e-82e5-f03536bb9baa tempest-CinderUnicodeTest-380732806 None] Acquiring lock "cinder-quobyte-23d1a037-9b75-4ae4-bfc5-478ee15f0f40" by "delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e3999433-2921-423e-82e5-f03536bb9baa tempest-CinderUnicodeTest-380732806 None] Lock "cinder-quobyte-23d1a037-9b75-4ae4-bfc5-478ee15f0f40" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e3999433-2921-423e-82e5-f03536bb9baa tempest-CinderUnicodeTest-380732806 None] Acquiring lock "cinder-quobyte-38320b51-f9ce-49b8-8d06-f7a758f91729" by "_delete_snapshot" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e3999433-2921-423e-82e5-f03536bb9baa tempest-CinderUnicodeTest-380732806 None] Lock "cinder-quobyte-38320b51-f9ce-49b8-8d06-f7a758f91729" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-e3999433-2921-423e-82e5-f03536bb9baa tempest-CinderUnicodeTest-380732806 None] Deleting offline snapshot 38320b51-f9ce-49b8-8d06-f7a758f91729 of volume 23d1a037-9b75-4ae4-bfc5-478ee15f0f40 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-e3999433-2921-423e-82e5-f03536bb9baa tempest-CinderUnicodeTest-380732806 None] snapshot_file for this snap is: volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40.38320b51-f9ce-49b8-8d06-f7a758f91729 {{(pid=82569) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd251d2-56f2-43b7-a86c-18b30be8cbf8]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e3999433-2921-423e-82e5-f03536bb9baa tempest-CinderUnicodeTest-380732806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40.38320b51-f9ce-49b8-8d06-f7a758f91729 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:58 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3c615b98-3dbd-4069-a32b-3113d60067dc tempest-VolumeDependencyTests-669614506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-76faddbc-ba7d-4337-adac-dcf368c1bbd4" returned: 0 in 0.589s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3c615b98-3dbd-4069-a32b-3113d60067dc tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-76faddbc-ba7d-4337-adac-dcf368c1bbd4 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:58 devstack sudo[90719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40.38320b51-f9ce-49b8-8d06-f7a758f91729 Apr 16 19:50:58 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:58 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-76faddbc-ba7d-4337-adac-dcf368c1bbd4 Apr 16 19:50:58 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:58 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474 1073741824" returned: 0 in 0.601s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:58 devstack sudo[90726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474 Apr 16 19:50:58 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:58 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3c615b98-3dbd-4069-a32b-3113d60067dc tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-76faddbc-ba7d-4337-adac-dcf368c1bbd4" returned: 0 in 0.515s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3c615b98-3dbd-4069-a32b-3113d60067dc tempest-VolumeDependencyTests-669614506 None] Lock "cinder-quobyte-76faddbc-ba7d-4337-adac-dcf368c1bbd4" released by "delete_volume" :: held 1.141s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-3c615b98-3dbd-4069-a32b-3113d60067dc tempest-VolumeDependencyTests-669614506 None] Created reservations ['bbfabbe1-d8af-440d-8ed2-3c4b814eced5', 'c040060b-9cd6-436c-bd35-48b4f7f7d868', '76bbe2a0-0ac3-4a29-bdbf-e92e904c3e8f', 'be38057e-f1c9-4bf6-9690-b6d2b3a178e1'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:50:58 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e3999433-2921-423e-82e5-f03536bb9baa tempest-CinderUnicodeTest-380732806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40.38320b51-f9ce-49b8-8d06-f7a758f91729" returned: 0 in 0.647s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-e3999433-2921-423e-82e5-f03536bb9baa tempest-CinderUnicodeTest-380732806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82569) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d741bb0-47fe-4d4d-b5ab-952f0e32f704]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e3999433-2921-423e-82e5-f03536bb9baa tempest-CinderUnicodeTest-380732806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3c615b98-3dbd-4069-a32b-3113d60067dc tempest-VolumeDependencyTests-669614506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3c615b98-3dbd-4069-a32b-3113d60067dc tempest-VolumeDependencyTests-669614506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3c615b98-3dbd-4069-a32b-3113d60067dc tempest-VolumeDependencyTests-669614506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3c615b98-3dbd-4069-a32b-3113d60067dc tempest-VolumeDependencyTests-669614506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3c615b98-3dbd-4069-a32b-3113d60067dc tempest-VolumeDependencyTests-669614506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3c615b98-3dbd-4069-a32b-3113d60067dc tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:58 devstack sudo[90732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40 Apr 16 19:50:58 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:58 devstack sudo[90734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:50:58 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:58 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474" returned: 0 in 0.548s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:50:58 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:50:59 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347c8fa5-6594-4bb7-aabc-2d938e5fe9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:59 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e0dd4c-084f-4afa-8103-66fc1d924ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:50:59 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Volume volume-b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474 (b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474): created successfully Apr 16 19:50:59 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e0dd4c-084f-4afa-8103-66fc1d924ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:50:59 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Flow 'volume_create_manager' (53a6ebae-bb1e-48e7-86ee-df8a2ac14b82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:50:59 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-5320044d-a7e2-4cc8-9ebb-0da5a8cdb7bc tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Created volume successfully. Apr 16 19:50:59 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3c615b98-3dbd-4069-a32b-3113d60067dc tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.503s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:59 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-3c615b98-3dbd-4069-a32b-3113d60067dc tempest-VolumeDependencyTests-669614506 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:50:59 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root Apr 16 19:50:59 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-3c615b98-3dbd-4069-a32b-3113d60067dc tempest-VolumeDependencyTests-669614506 None] Deleted volume successfully. Apr 16 19:50:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e3999433-2921-423e-82e5-f03536bb9baa tempest-CinderUnicodeTest-380732806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40" returned: 0 in 0.572s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:50:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e3999433-2921-423e-82e5-f03536bb9baa tempest-CinderUnicodeTest-380732806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40.38320b51-f9ce-49b8-8d06-f7a758f91729 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:50:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-3c615b98-3dbd-4069-a32b-3113d60067dc tempest-VolumeDependencyTests-669614506 None] Lock "cinder-76faddbc-ba7d-4337-adac-dcf368c1bbd4-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:50:59 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40.38320b51-f9ce-49b8-8d06-f7a758f91729 Apr 16 19:50:59 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:50:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a64a4750-7a60-4f9e-98d6-beb83a28b674 tempest-VolumeDependencyTests-669614506 None] Acquiring lock "cinder-c467ea55-e362-4765-8729-64c350538b8a-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a64a4750-7a60-4f9e-98d6-beb83a28b674 tempest-VolumeDependencyTests-669614506 None] Lock "cinder-c467ea55-e362-4765-8729-64c350538b8a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a64a4750-7a60-4f9e-98d6-beb83a28b674 tempest-VolumeDependencyTests-669614506 None] Acquiring lock "cinder-quobyte-c467ea55-e362-4765-8729-64c350538b8a" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:50:59 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a64a4750-7a60-4f9e-98d6-beb83a28b674 tempest-VolumeDependencyTests-669614506 None] Lock "cinder-quobyte-c467ea55-e362-4765-8729-64c350538b8a" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:50:59 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdae717-0302-4928-9b24-d5916ae398bc]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:50:59 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a64a4750-7a60-4f9e-98d6-beb83a28b674 tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c467ea55-e362-4765-8729-64c350538b8a {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:00 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e3999433-2921-423e-82e5-f03536bb9baa tempest-CinderUnicodeTest-380732806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40.38320b51-f9ce-49b8-8d06-f7a758f91729" returned: 0 in 0.613s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e3999433-2921-423e-82e5-f03536bb9baa tempest-CinderUnicodeTest-380732806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40.38320b51-f9ce-49b8-8d06-f7a758f91729 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:00 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c467ea55-e362-4765-8729-64c350538b8a Apr 16 19:51:00 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:00 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40.38320b51-f9ce-49b8-8d06-f7a758f91729 Apr 16 19:51:00 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Flow 'volume_create_manager' (9b61afd3-85e1-4327-8841-7a02379b2276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5718e51b-a32b-4f09-aadd-38c5a53c01dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5718e51b-a32b-4f09-aadd-38c5a53c01dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-269511596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b39d2149-3fba-41f9-ae46-7f8597261f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1379292c103541459c405158e8e6d8f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:00Z,use_quota=True,user_id='7cd3a3a831bd4b7a99c940821bb07497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec62f8a3-c4eb-4d30-892c-25004ea7e496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec62f8a3-c4eb-4d30-892c-25004ea7e496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb0039f-40fa-4819-abab-f9cb59c5b3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb0039f-40fa-4819-abab-f9cb59c5b3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b39d2149-3fba-41f9-ae46-7f8597261f19', 'volume_name': 'volume-b39d2149-3fba-41f9-ae46-7f8597261f19', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153adc92-75e3-4904-a292-7eadb95f0bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153adc92-75e3-4904-a292-7eadb95f0bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6b4d1c-d31d-49cc-bd0e-660ca63d77f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:00 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Volume b39d2149-3fba-41f9-ae46-7f8597261f19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b39d2149-3fba-41f9-ae46-7f8597261f19', 'volume_size': 1} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-269511596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b39d2149-3fba-41f9-ae46-7f8597261f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1379292c103541459c405158e8e6d8f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:00Z,use_quota=True,user_id='7cd3a3a831bd4b7a99c940821bb07497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Creating volume b39d2149-3fba-41f9-ae46-7f8597261f19 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:51:00 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b39d2149-3fba-41f9-ae46-7f8597261f19 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:00 devstack sudo[90752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b39d2149-3fba-41f9-ae46-7f8597261f19 1073741824 Apr 16 19:51:00 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Flow 'volume_create_manager' (3875d242-381e-4c34-b3cc-60b01813fb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad3dd78-5e91-48ec-af97-31a5b4cba9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad3dd78-5e91-48ec-af97-31a5b4cba9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1167187463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36841d4-b029-4f29-ad76-376d298affd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1379292c103541459c405158e8e6d8f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:01Z,use_quota=True,user_id='7cd3a3a831bd4b7a99c940821bb07497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e0302ce-ca36-41e6-890e-591595015a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e0302ce-ca36-41e6-890e-591595015a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8ca1eb-3bd4-4348-b175-525e0e946224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:00 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8ca1eb-3bd4-4348-b175-525e0e946224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e36841d4-b029-4f29-ad76-376d298affd8', 'volume_name': 'volume-e36841d4-b029-4f29-ad76-376d298affd8', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f03386b7-c281-497f-81c1-795a57e20c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f03386b7-c281-497f-81c1-795a57e20c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77dbeb7e-6068-41af-85e0-41099dc18ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:00 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Volume e36841d4-b029-4f29-ad76-376d298affd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e36841d4-b029-4f29-ad76-376d298affd8', 'volume_size': 1} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a64a4750-7a60-4f9e-98d6-beb83a28b674 tempest-VolumeDependencyTests-669614506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c467ea55-e362-4765-8729-64c350538b8a" returned: 0 in 0.797s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a64a4750-7a60-4f9e-98d6-beb83a28b674 tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c467ea55-e362-4765-8729-64c350538b8a {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:00 devstack sudo[90758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c467ea55-e362-4765-8729-64c350538b8a Apr 16 19:51:00 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:00 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-e3999433-2921-423e-82e5-f03536bb9baa tempest-CinderUnicodeTest-380732806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40.38320b51-f9ce-49b8-8d06-f7a758f91729" returned: 0 in 0.875s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e3999433-2921-423e-82e5-f03536bb9baa tempest-CinderUnicodeTest-380732806 None] Lock "cinder-quobyte-38320b51-f9ce-49b8-8d06-f7a758f91729" released by "_delete_snapshot" :: held 2.785s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:51:00 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Flow 'volume_create_manager' (787a9afc-5dd1-4c89-9fb1-a070fae0d821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4804826-d62a-4d39-80a0-72172cefed94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e3999433-2921-423e-82e5-f03536bb9baa tempest-CinderUnicodeTest-380732806 None] Lock "cinder-quobyte-23d1a037-9b75-4ae4-bfc5-478ee15f0f40" released by "delete_snapshot" :: held 2.833s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4804826-d62a-4d39-80a0-72172cefed94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1797528085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfebe26c-efd4-444b-a4ef-0382d699d772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1379292c103541459c405158e8e6d8f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:01Z,use_quota=True,user_id='7cd3a3a831bd4b7a99c940821bb07497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8571f068-0dfb-4ff8-b174-c560403380b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8571f068-0dfb-4ff8-b174-c560403380b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e017a2b0-cb3a-413a-8d07-d94783e7cdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e017a2b0-cb3a-413a-8d07-d94783e7cdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfebe26c-efd4-444b-a4ef-0382d699d772', 'volume_name': 'volume-dfebe26c-efd4-444b-a4ef-0382d699d772', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97309b1f-264e-41ac-82c9-af826b026f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97309b1f-264e-41ac-82c9-af826b026f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a7323e-d68a-4fd3-88d5-314e3d2b47e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:01 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Volume dfebe26c-efd4-444b-a4ef-0382d699d772: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfebe26c-efd4-444b-a4ef-0382d699d772', 'volume_size': 1} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-e3999433-2921-423e-82e5-f03536bb9baa tempest-CinderUnicodeTest-380732806 None] Created reservations ['143b6940-7c6d-4596-8a5f-67a44a25dc11', 'cb2808aa-3329-4034-bf5e-c6fefab810a9', '1445efe2-5c10-4cc2-87d2-58bc6d6b29f9', 'ed25695c-6159-4548-906d-e5154c5642a5'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:51:01 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-e3999433-2921-423e-82e5-f03536bb9baa tempest-CinderUnicodeTest-380732806 None] Delete snapshot completed successfully. Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-e3999433-2921-423e-82e5-f03536bb9baa tempest-CinderUnicodeTest-380732806 None] Lock "cinder-38320b51-f9ce-49b8-8d06-f7a758f91729-delete_snapshot" released by "delete_snapshot" :: held 3.012s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Flow 'volume_create_manager' (db7db545-5431-4f32-a04a-a595d31ea7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af7f6db7-01e6-485c-86e2-1c54a3244cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af7f6db7-01e6-485c-86e2-1c54a3244cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1149825396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1379292c103541459c405158e8e6d8f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:01Z,use_quota=True,user_id='7cd3a3a831bd4b7a99c940821bb07497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb74474-8cea-493d-aabb-1e7b78e04ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:01 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb74474-8cea-493d-aabb-1e7b78e04ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5525ea4c-ba79-412b-b418-aa9185940ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5525ea4c-ba79-412b-b418-aa9185940ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1', 'volume_name': 'volume-1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d50b43-c5a0-4ca3-8a57-bec61d0e57f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d50b43-c5a0-4ca3-8a57-bec61d0e57f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (822b9422-3891-4a1a-ad1e-29cd24192bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:01 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Volume 1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1', 'volume_size': 1} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b39d2149-3fba-41f9-ae46-7f8597261f19 1073741824" returned: 0 in 0.896s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b39d2149-3fba-41f9-ae46-7f8597261f19 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:01 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b39d2149-3fba-41f9-ae46-7f8597261f19 Apr 16 19:51:01 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bcd28993-4c64-4cdf-9a0d-0f3d2c2bda93 tempest-CinderUnicodeTest-380732806 None] Acquiring lock "cinder-23d1a037-9b75-4ae4-bfc5-478ee15f0f40-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:51:01 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.flows.manager.create_volume [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82569) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Flow 'volume_create_manager' (4c804afd-fe9f-4172-90e7-8244fb46ec28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (385ded64-bb5a-4456-8887-858d9c0268f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (385ded64-bb5a-4456-8887-858d9c0268f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1206287776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a26b347-2a73-4670-ad5d-e735eaa88878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1379292c103541459c405158e8e6d8f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:01Z,use_quota=True,user_id='7cd3a3a831bd4b7a99c940821bb07497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eaf100e-7543-4fc8-a3ad-ea3727b0af41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eaf100e-7543-4fc8-a3ad-ea3727b0af41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b70e4e0-8c5b-445c-915b-4c5473ffda3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b70e4e0-8c5b-445c-915b-4c5473ffda3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a26b347-2a73-4670-ad5d-e735eaa88878', 'volume_name': 'volume-1a26b347-2a73-4670-ad5d-e735eaa88878', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d4a7272-8295-4047-99ec-39a803e499dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d4a7272-8295-4047-99ec-39a803e499dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea946171-1fd9-40f1-a104-4872d286bc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:01 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Volume 1a26b347-2a73-4670-ad5d-e735eaa88878: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a26b347-2a73-4670-ad5d-e735eaa88878', 'volume_size': 1} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bcd28993-4c64-4cdf-9a0d-0f3d2c2bda93 tempest-CinderUnicodeTest-380732806 None] Lock "cinder-23d1a037-9b75-4ae4-bfc5-478ee15f0f40-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a64a4750-7a60-4f9e-98d6-beb83a28b674 tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-c467ea55-e362-4765-8729-64c350538b8a" returned: 0 in 0.698s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bcd28993-4c64-4cdf-9a0d-0f3d2c2bda93 tempest-CinderUnicodeTest-380732806 None] Acquiring lock "cinder-quobyte-23d1a037-9b75-4ae4-bfc5-478ee15f0f40" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a64a4750-7a60-4f9e-98d6-beb83a28b674 tempest-VolumeDependencyTests-669614506 None] Lock "cinder-quobyte-c467ea55-e362-4765-8729-64c350538b8a" released by "delete_volume" :: held 1.536s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bcd28993-4c64-4cdf-9a0d-0f3d2c2bda93 tempest-CinderUnicodeTest-380732806 None] Lock "cinder-quobyte-23d1a037-9b75-4ae4-bfc5-478ee15f0f40" acquired by "delete_volume" :: waited 0.023s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c14c843-afe8-47b8-aabb-25ce6c62261f]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcd28993-4c64-4cdf-9a0d-0f3d2c2bda93 tempest-CinderUnicodeTest-380732806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-a64a4750-7a60-4f9e-98d6-beb83a28b674 tempest-VolumeDependencyTests-669614506 None] Created reservations ['6ec499c6-00b4-4e55-a121-739b49e018e5', '433d8aa1-4610-4352-bf19-c5ce1c80a5d1', '3450f913-19bf-405e-aa93-4402c5fff837', '56abee3a-6bad-4a35-9bc3-4e0f6ac98c31'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:51:01 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40 Apr 16 19:51:01 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a64a4750-7a60-4f9e-98d6-beb83a28b674 tempest-VolumeDependencyTests-669614506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a64a4750-7a60-4f9e-98d6-beb83a28b674 tempest-VolumeDependencyTests-669614506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-a64a4750-7a60-4f9e-98d6-beb83a28b674 tempest-VolumeDependencyTests-669614506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-a64a4750-7a60-4f9e-98d6-beb83a28b674 tempest-VolumeDependencyTests-669614506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-a64a4750-7a60-4f9e-98d6-beb83a28b674 tempest-VolumeDependencyTests-669614506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a64a4750-7a60-4f9e-98d6-beb83a28b674 tempest-VolumeDependencyTests-669614506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:01 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:51:01 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:01 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b39d2149-3fba-41f9-ae46-7f8597261f19" returned: 0 in 0.475s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1167187463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36841d4-b029-4f29-ad76-376d298affd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1379292c103541459c405158e8e6d8f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:01Z,use_quota=True,user_id='7cd3a3a831bd4b7a99c940821bb07497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Creating volume e36841d4-b029-4f29-ad76-376d298affd8 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:51:01 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e36841d4-b029-4f29-ad76-376d298affd8 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6b4d1c-d31d-49cc-bd0e-660ca63d77f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b39d2149-3fba-41f9-ae46-7f8597261f19', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:01 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e36841d4-b029-4f29-ad76-376d298affd8 1073741824 Apr 16 19:51:01 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e2b4cf-aef3-4106-ae65-feaa850d67ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:01 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Volume volume-b39d2149-3fba-41f9-ae46-7f8597261f19 (b39d2149-3fba-41f9-ae46-7f8597261f19): created successfully Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e2b4cf-aef3-4106-ae65-feaa850d67ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:01 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Flow 'volume_create_manager' (9b61afd3-85e1-4327-8841-7a02379b2276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:51:01 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-6ba3ecb5-b6d7-4726-ad6e-633e9409d11e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Created volume successfully. Apr 16 19:51:02 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcd28993-4c64-4cdf-9a0d-0f3d2c2bda93 tempest-CinderUnicodeTest-380732806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40" returned: 0 in 0.499s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcd28993-4c64-4cdf-9a0d-0f3d2c2bda93 tempest-CinderUnicodeTest-380732806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:02 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40 Apr 16 19:51:02 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:02 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-a64a4750-7a60-4f9e-98d6-beb83a28b674 tempest-VolumeDependencyTests-669614506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.432s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-a64a4750-7a60-4f9e-98d6-beb83a28b674 tempest-VolumeDependencyTests-669614506 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:51:02 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-a64a4750-7a60-4f9e-98d6-beb83a28b674 tempest-VolumeDependencyTests-669614506 None] Deleted volume successfully. Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-a64a4750-7a60-4f9e-98d6-beb83a28b674 tempest-VolumeDependencyTests-669614506 None] Lock "cinder-c467ea55-e362-4765-8729-64c350538b8a-delete_volume" released by "delete_volume" :: held 2.180s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:51:02 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e36841d4-b029-4f29-ad76-376d298affd8 1073741824" returned: 0 in 0.544s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e36841d4-b029-4f29-ad76-376d298affd8 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:02 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e36841d4-b029-4f29-ad76-376d298affd8 Apr 16 19:51:02 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:02 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcd28993-4c64-4cdf-9a0d-0f3d2c2bda93 tempest-CinderUnicodeTest-380732806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-23d1a037-9b75-4ae4-bfc5-478ee15f0f40" returned: 0 in 0.476s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bcd28993-4c64-4cdf-9a0d-0f3d2c2bda93 tempest-CinderUnicodeTest-380732806 None] Lock "cinder-quobyte-23d1a037-9b75-4ae4-bfc5-478ee15f0f40" released by "delete_volume" :: held 1.014s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-bcd28993-4c64-4cdf-9a0d-0f3d2c2bda93 tempest-CinderUnicodeTest-380732806 None] Created reservations ['27936d59-a0f4-4125-9d12-45789d7151e0', '71fc7955-c9e4-4286-af18-7b3c8fdd659b', 'a8cc213d-21b0-425f-a395-256815885c27', '5bfa74fa-5657-4268-8728-5382980f09f2'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bcd28993-4c64-4cdf-9a0d-0f3d2c2bda93 tempest-CinderUnicodeTest-380732806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bcd28993-4c64-4cdf-9a0d-0f3d2c2bda93 tempest-CinderUnicodeTest-380732806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bcd28993-4c64-4cdf-9a0d-0f3d2c2bda93 tempest-CinderUnicodeTest-380732806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-bcd28993-4c64-4cdf-9a0d-0f3d2c2bda93 tempest-CinderUnicodeTest-380732806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-bcd28993-4c64-4cdf-9a0d-0f3d2c2bda93 tempest-CinderUnicodeTest-380732806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcd28993-4c64-4cdf-9a0d-0f3d2c2bda93 tempest-CinderUnicodeTest-380732806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:02 devstack sudo[90785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:51:02 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:02 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e36841d4-b029-4f29-ad76-376d298affd8" returned: 0 in 0.517s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.796s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1797528085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfebe26c-efd4-444b-a4ef-0382d699d772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1379292c103541459c405158e8e6d8f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:01Z,use_quota=True,user_id='7cd3a3a831bd4b7a99c940821bb07497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Creating volume dfebe26c-efd4-444b-a4ef-0382d699d772 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:51:02 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dfebe26c-efd4-444b-a4ef-0382d699d772 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77dbeb7e-6068-41af-85e0-41099dc18ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e36841d4-b029-4f29-ad76-376d298affd8', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:02 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dfebe26c-efd4-444b-a4ef-0382d699d772 1073741824 Apr 16 19:51:02 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c63acc-fce0-44d6-afe2-9caf53898e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:02 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Volume volume-e36841d4-b029-4f29-ad76-376d298affd8 (e36841d4-b029-4f29-ad76-376d298affd8): created successfully Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c63acc-fce0-44d6-afe2-9caf53898e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:02 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Flow 'volume_create_manager' (3875d242-381e-4c34-b3cc-60b01813fb7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:51:02 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-df964461-3320-497b-a54f-a350d7270ef8 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Created volume successfully. Apr 16 19:51:03 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-bcd28993-4c64-4cdf-9a0d-0f3d2c2bda93 tempest-CinderUnicodeTest-380732806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.467s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:03 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-bcd28993-4c64-4cdf-9a0d-0f3d2c2bda93 tempest-CinderUnicodeTest-380732806 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:51:03 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-bcd28993-4c64-4cdf-9a0d-0f3d2c2bda93 tempest-CinderUnicodeTest-380732806 None] Deleted volume successfully. Apr 16 19:51:03 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-bcd28993-4c64-4cdf-9a0d-0f3d2c2bda93 tempest-CinderUnicodeTest-380732806 None] Lock "cinder-23d1a037-9b75-4ae4-bfc5-478ee15f0f40-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:51:03 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dfebe26c-efd4-444b-a4ef-0382d699d772 1073741824" returned: 0 in 0.624s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dfebe26c-efd4-444b-a4ef-0382d699d772 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:03 devstack sudo[90795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dfebe26c-efd4-444b-a4ef-0382d699d772 Apr 16 19:51:03 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:03 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b6873b1a-89a3-44d9-9c7a-bf06a647c37c tempest-CinderUnicodeTest-380732806 None] Acquiring lock "cinder-9d80db18-8cf1-437d-ab5b-9e8be1df09df-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:51:03 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b6873b1a-89a3-44d9-9c7a-bf06a647c37c tempest-CinderUnicodeTest-380732806 None] Lock "cinder-9d80db18-8cf1-437d-ab5b-9e8be1df09df-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:51:03 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b6873b1a-89a3-44d9-9c7a-bf06a647c37c tempest-CinderUnicodeTest-380732806 None] Acquiring lock "cinder-quobyte-9d80db18-8cf1-437d-ab5b-9e8be1df09df" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:51:03 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b6873b1a-89a3-44d9-9c7a-bf06a647c37c tempest-CinderUnicodeTest-380732806 None] Lock "cinder-quobyte-9d80db18-8cf1-437d-ab5b-9e8be1df09df" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:51:03 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4c82be-ed17-4dbb-8a99-3eae571b89de]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:51:03 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b6873b1a-89a3-44d9-9c7a-bf06a647c37c tempest-CinderUnicodeTest-380732806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-9d80db18-8cf1-437d-ab5b-9e8be1df09df {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:03 devstack sudo[90797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-9d80db18-8cf1-437d-ab5b-9e8be1df09df Apr 16 19:51:03 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:04 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dfebe26c-efd4-444b-a4ef-0382d699d772" returned: 0 in 0.492s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.775s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1149825396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1379292c103541459c405158e8e6d8f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:01Z,use_quota=True,user_id='7cd3a3a831bd4b7a99c940821bb07497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Creating volume 1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:51:04 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a7323e-d68a-4fd3-88d5-314e3d2b47e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfebe26c-efd4-444b-a4ef-0382d699d772', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:04 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1 1073741824 Apr 16 19:51:04 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c54440b6-982f-429e-9f80-9f1692649e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:04 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Volume volume-dfebe26c-efd4-444b-a4ef-0382d699d772 (dfebe26c-efd4-444b-a4ef-0382d699d772): created successfully Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c54440b6-982f-429e-9f80-9f1692649e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Flow 'volume_create_manager' (787a9afc-5dd1-4c89-9fb1-a070fae0d821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:51:04 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-3a9a616a-cec4-4dba-a41b-031ad6b98709 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Created volume successfully. Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG oslo_service.periodic_task [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82569) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:04 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:51:04 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:04 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b6873b1a-89a3-44d9-9c7a-bf06a647c37c tempest-CinderUnicodeTest-380732806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-9d80db18-8cf1-437d-ab5b-9e8be1df09df" returned: 0 in 0.568s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b6873b1a-89a3-44d9-9c7a-bf06a647c37c tempest-CinderUnicodeTest-380732806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-9d80db18-8cf1-437d-ab5b-9e8be1df09df {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:04 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-9d80db18-8cf1-437d-ab5b-9e8be1df09df Apr 16 19:51:04 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:04 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1 1073741824" returned: 0 in 0.502s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:04 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.447s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-d6d854a6-c759-483c-bb16-ef7d6302dce1 None None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:04 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1 Apr 16 19:51:04 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:04 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b6873b1a-89a3-44d9-9c7a-bf06a647c37c tempest-CinderUnicodeTest-380732806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-9d80db18-8cf1-437d-ab5b-9e8be1df09df" returned: 0 in 0.497s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b6873b1a-89a3-44d9-9c7a-bf06a647c37c tempest-CinderUnicodeTest-380732806 None] Lock "cinder-quobyte-9d80db18-8cf1-437d-ab5b-9e8be1df09df" released by "delete_volume" :: held 1.089s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-b6873b1a-89a3-44d9-9c7a-bf06a647c37c tempest-CinderUnicodeTest-380732806 None] Created reservations ['b2ff8212-21c1-4393-873c-52a9fe5589a1', 'a32f03fc-bbd1-4fbb-b20a-5df6b4e723f5', 'f9eea918-e86a-44b6-ae58-97962221f49c', '4c53adc0-411b-4a88-845f-26a6f2e4148c'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b6873b1a-89a3-44d9-9c7a-bf06a647c37c tempest-CinderUnicodeTest-380732806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b6873b1a-89a3-44d9-9c7a-bf06a647c37c tempest-CinderUnicodeTest-380732806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-b6873b1a-89a3-44d9-9c7a-bf06a647c37c tempest-CinderUnicodeTest-380732806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-b6873b1a-89a3-44d9-9c7a-bf06a647c37c tempest-CinderUnicodeTest-380732806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-b6873b1a-89a3-44d9-9c7a-bf06a647c37c tempest-CinderUnicodeTest-380732806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:51:04 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b6873b1a-89a3-44d9-9c7a-bf06a647c37c tempest-CinderUnicodeTest-380732806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:04 devstack sudo[90816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:51:04 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:05 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1" returned: 0 in 0.437s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.565s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T17:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1206287776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a26b347-2a73-4670-ad5d-e735eaa88878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1379292c103541459c405158e8e6d8f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T17:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T17:51:01Z,use_quota=True,user_id='7cd3a3a831bd4b7a99c940821bb07497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5678f02c-0a16-4746-8157-e7ec3e75a21d),volume_type_id=5678f02c-0a16-4746-8157-e7ec3e75a21d)}" {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.remotefs [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Creating volume 1a26b347-2a73-4670-ad5d-e735eaa88878 {{(pid=82569) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Selected osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c as target Quobyte volume. {{(pid=82569) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 19:51:05 devstack cinder-volume[82569]: INFO cinder.volume.drivers.remotefs [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] casted to osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1a26b347-2a73-4670-ad5d-e735eaa88878 1073741824 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (822b9422-3891-4a1a-ad1e-29cd24192bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:05 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1a26b347-2a73-4670-ad5d-e735eaa88878 1073741824 Apr 16 19:51:05 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf9ce7a-d53f-40da-970e-b3a4cd321717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:05 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Volume volume-1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1 (1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1): created successfully Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf9ce7a-d53f-40da-970e-b3a4cd321717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Flow 'volume_create_manager' (db7db545-5431-4f32-a04a-a595d31ea7c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:51:05 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-2e3800d0-9a07-4fd3-bb40-63d9258f4d81 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Created volume successfully. Apr 16 19:51:05 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-b6873b1a-89a3-44d9-9c7a-bf06a647c37c tempest-CinderUnicodeTest-380732806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.415s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-b6873b1a-89a3-44d9-9c7a-bf06a647c37c tempest-CinderUnicodeTest-380732806 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:51:05 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-b6873b1a-89a3-44d9-9c7a-bf06a647c37c tempest-CinderUnicodeTest-380732806 None] Deleted volume successfully. Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-b6873b1a-89a3-44d9-9c7a-bf06a647c37c tempest-CinderUnicodeTest-380732806 None] Lock "cinder-9d80db18-8cf1-437d-ab5b-9e8be1df09df-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:51:05 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1a26b347-2a73-4670-ad5d-e735eaa88878 1073741824" returned: 0 in 0.491s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1a26b347-2a73-4670-ad5d-e735eaa88878 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:05 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1a26b347-2a73-4670-ad5d-e735eaa88878 Apr 16 19:51:05 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:05 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1a26b347-2a73-4670-ad5d-e735eaa88878" returned: 0 in 0.424s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'} {{(pid=82569) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea946171-1fd9-40f1-a104-4872d286bc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a26b347-2a73-4670-ad5d-e735eaa88878', 'volume_size': 1}' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05cd3039-1e08-4def-9595-a6b56c467d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 19:51:05 devstack cinder-volume[82569]: INFO cinder.volume.flows.manager.create_volume [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Volume volume-1a26b347-2a73-4670-ad5d-e735eaa88878 (1a26b347-2a73-4670-ad5d-e735eaa88878): created successfully Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05cd3039-1e08-4def-9595-a6b56c467d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82569) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 19:51:05 devstack cinder-volume[82569]: DEBUG cinder.volume.manager [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Flow 'volume_create_manager' (4c804afd-fe9f-4172-90e7-8244fb46ec28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82569) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 19:51:06 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-78607a11-40dc-42ac-8e73-a3c1e02c6399 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Created volume successfully. Apr 16 19:51:06 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-91188bee-259b-461f-b20c-6d1f77965408 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "cinder-1a26b347-2a73-4670-ad5d-e735eaa88878-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:51:06 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-91188bee-259b-461f-b20c-6d1f77965408 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "cinder-1a26b347-2a73-4670-ad5d-e735eaa88878-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:51:06 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-91188bee-259b-461f-b20c-6d1f77965408 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "cinder-quobyte-1a26b347-2a73-4670-ad5d-e735eaa88878" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:51:06 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-91188bee-259b-461f-b20c-6d1f77965408 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "cinder-quobyte-1a26b347-2a73-4670-ad5d-e735eaa88878" acquired by "delete_volume" :: waited 0.007s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:51:06 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3da7a2-1a0e-48ad-bbf4-8e6c52bba9b7]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:51:06 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-91188bee-259b-461f-b20c-6d1f77965408 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1a26b347-2a73-4670-ad5d-e735eaa88878 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:06 devstack sudo[90828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1a26b347-2a73-4670-ad5d-e735eaa88878 Apr 16 19:51:06 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:07 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-91188bee-259b-461f-b20c-6d1f77965408 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1a26b347-2a73-4670-ad5d-e735eaa88878" returned: 0 in 0.460s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-91188bee-259b-461f-b20c-6d1f77965408 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1a26b347-2a73-4670-ad5d-e735eaa88878 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:07 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1a26b347-2a73-4670-ad5d-e735eaa88878 Apr 16 19:51:07 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:07 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-91188bee-259b-461f-b20c-6d1f77965408 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1a26b347-2a73-4670-ad5d-e735eaa88878" returned: 0 in 0.420s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:07 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-91188bee-259b-461f-b20c-6d1f77965408 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "cinder-quobyte-1a26b347-2a73-4670-ad5d-e735eaa88878" released by "delete_volume" :: held 0.908s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:51:07 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-91188bee-259b-461f-b20c-6d1f77965408 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Created reservations ['d473e2d2-84cc-4182-a509-353807f7f5b1', '45537bfa-bbc8-434e-8676-25d4e4d2b408', '89cf06d5-57b0-406e-b0dc-ea6eac949ac7', '925a58d7-abc1-4972-832e-fc76c82d9cb4'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:51:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-91188bee-259b-461f-b20c-6d1f77965408 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:51:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-91188bee-259b-461f-b20c-6d1f77965408 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:51:07 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-91188bee-259b-461f-b20c-6d1f77965408 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:51:07 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-91188bee-259b-461f-b20c-6d1f77965408 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:51:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-91188bee-259b-461f-b20c-6d1f77965408 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:51:07 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-91188bee-259b-461f-b20c-6d1f77965408 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:07 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:51:07 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:07 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c67e7663-d090-4786-8a43-c18102d207db tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "cinder-1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:51:08 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c67e7663-d090-4786-8a43-c18102d207db tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "cinder-1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:51:08 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c67e7663-d090-4786-8a43-c18102d207db tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "cinder-quobyte-1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:51:08 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c67e7663-d090-4786-8a43-c18102d207db tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "cinder-quobyte-1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1" acquired by "delete_volume" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:51:08 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[243fcdb6-7a4c-43e0-b30e-613d35ada83d]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:51:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c67e7663-d090-4786-8a43-c18102d207db tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:08 devstack sudo[90838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1 Apr 16 19:51:08 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:08 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-91188bee-259b-461f-b20c-6d1f77965408 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.431s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:08 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-91188bee-259b-461f-b20c-6d1f77965408 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:51:08 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-91188bee-259b-461f-b20c-6d1f77965408 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Deleted volume successfully. Apr 16 19:51:08 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-91188bee-259b-461f-b20c-6d1f77965408 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "cinder-1a26b347-2a73-4670-ad5d-e735eaa88878-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:51:08 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c67e7663-d090-4786-8a43-c18102d207db tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1" returned: 0 in 0.486s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c67e7663-d090-4786-8a43-c18102d207db tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:08 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1 Apr 16 19:51:08 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:08 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:08 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c67e7663-d090-4786-8a43-c18102d207db tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1" returned: 0 in 0.396s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:08 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c67e7663-d090-4786-8a43-c18102d207db tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "cinder-quobyte-1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1" released by "delete_volume" :: held 0.902s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:51:08 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-c67e7663-d090-4786-8a43-c18102d207db tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Created reservations ['c6fcfd8e-52cd-4f90-a923-745ad32cdae7', 'e1319425-27d7-44ef-b3a6-f2902eecad4c', 'cb94f0f6-f7f2-412e-a696-227e63b46242', 'b25c830c-fadd-47bb-937c-c9636bc37605'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:51:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-c67e7663-d090-4786-8a43-c18102d207db tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:51:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-c67e7663-d090-4786-8a43-c18102d207db tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:51:09 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-c67e7663-d090-4786-8a43-c18102d207db tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:51:09 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-c67e7663-d090-4786-8a43-c18102d207db tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:51:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-c67e7663-d090-4786-8a43-c18102d207db tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:51:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c67e7663-d090-4786-8a43-c18102d207db tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:09 devstack sudo[90847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:51:09 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:09 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-59658fc4-2744-4b7d-90f6-e7f987c4f05b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "cinder-dfebe26c-efd4-444b-a4ef-0382d699d772-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:51:09 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-59658fc4-2744-4b7d-90f6-e7f987c4f05b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "cinder-dfebe26c-efd4-444b-a4ef-0382d699d772-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:51:09 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-59658fc4-2744-4b7d-90f6-e7f987c4f05b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "cinder-quobyte-dfebe26c-efd4-444b-a4ef-0382d699d772" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:51:09 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-59658fc4-2744-4b7d-90f6-e7f987c4f05b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "cinder-quobyte-dfebe26c-efd4-444b-a4ef-0382d699d772" acquired by "delete_volume" :: waited 0.007s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:51:09 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[9135e0cb-030e-4308-b6ac-505bb1dbcf08]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:51:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-59658fc4-2744-4b7d-90f6-e7f987c4f05b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dfebe26c-efd4-444b-a4ef-0382d699d772 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:09 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dfebe26c-efd4-444b-a4ef-0382d699d772 Apr 16 19:51:09 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:09 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-c67e7663-d090-4786-8a43-c18102d207db tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.427s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:09 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-c67e7663-d090-4786-8a43-c18102d207db tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:51:09 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-c67e7663-d090-4786-8a43-c18102d207db tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Deleted volume successfully. Apr 16 19:51:09 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-c67e7663-d090-4786-8a43-c18102d207db tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "cinder-1f6b7c76-e8ec-4838-8e78-6be24cc9b5b1-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:51:09 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-59658fc4-2744-4b7d-90f6-e7f987c4f05b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dfebe26c-efd4-444b-a4ef-0382d699d772" returned: 0 in 0.479s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:09 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-59658fc4-2744-4b7d-90f6-e7f987c4f05b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dfebe26c-efd4-444b-a4ef-0382d699d772 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:09 devstack sudo[90857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dfebe26c-efd4-444b-a4ef-0382d699d772 Apr 16 19:51:09 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:10 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-59658fc4-2744-4b7d-90f6-e7f987c4f05b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-dfebe26c-efd4-444b-a4ef-0382d699d772" returned: 0 in 0.393s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:10 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-59658fc4-2744-4b7d-90f6-e7f987c4f05b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "cinder-quobyte-dfebe26c-efd4-444b-a4ef-0382d699d772" released by "delete_volume" :: held 0.908s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:51:10 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-59658fc4-2744-4b7d-90f6-e7f987c4f05b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Created reservations ['df2cca4c-7c7f-47c2-a664-2a062a0832c8', 'd949cb1e-02cc-4d2b-bff7-a1f0b591612c', '2c011ff1-f7a6-4d1c-a13c-fecf84f00f6b', 'cbf3117f-0ff4-4ac8-b98f-01fe0852d22a'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:51:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-59658fc4-2744-4b7d-90f6-e7f987c4f05b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:51:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-59658fc4-2744-4b7d-90f6-e7f987c4f05b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:51:10 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-59658fc4-2744-4b7d-90f6-e7f987c4f05b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:51:10 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-59658fc4-2744-4b7d-90f6-e7f987c4f05b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:51:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-59658fc4-2744-4b7d-90f6-e7f987c4f05b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:51:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-59658fc4-2744-4b7d-90f6-e7f987c4f05b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:10 devstack sudo[90860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:51:10 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:10 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0c250628-cd88-456e-bba6-84c27664b346 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "cinder-e36841d4-b029-4f29-ad76-376d298affd8-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:51:10 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0c250628-cd88-456e-bba6-84c27664b346 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "cinder-e36841d4-b029-4f29-ad76-376d298affd8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:51:10 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0c250628-cd88-456e-bba6-84c27664b346 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "cinder-quobyte-e36841d4-b029-4f29-ad76-376d298affd8" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:51:10 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0c250628-cd88-456e-bba6-84c27664b346 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "cinder-quobyte-e36841d4-b029-4f29-ad76-376d298affd8" acquired by "delete_volume" :: waited 0.008s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:51:10 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f9cf15-ebf2-4a68-8648-6d3e505d4769]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:51:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0c250628-cd88-456e-bba6-84c27664b346 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e36841d4-b029-4f29-ad76-376d298affd8 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:10 devstack sudo[90862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e36841d4-b029-4f29-ad76-376d298affd8 Apr 16 19:51:10 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:10 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-59658fc4-2744-4b7d-90f6-e7f987c4f05b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.423s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:10 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-59658fc4-2744-4b7d-90f6-e7f987c4f05b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:51:10 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-59658fc4-2744-4b7d-90f6-e7f987c4f05b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Deleted volume successfully. Apr 16 19:51:10 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-59658fc4-2744-4b7d-90f6-e7f987c4f05b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "cinder-dfebe26c-efd4-444b-a4ef-0382d699d772-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:51:10 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0c250628-cd88-456e-bba6-84c27664b346 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e36841d4-b029-4f29-ad76-376d298affd8" returned: 0 in 0.468s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:10 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0c250628-cd88-456e-bba6-84c27664b346 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e36841d4-b029-4f29-ad76-376d298affd8 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:10 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e36841d4-b029-4f29-ad76-376d298affd8 Apr 16 19:51:10 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:11 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0c250628-cd88-456e-bba6-84c27664b346 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-e36841d4-b029-4f29-ad76-376d298affd8" returned: 0 in 0.388s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0c250628-cd88-456e-bba6-84c27664b346 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "cinder-quobyte-e36841d4-b029-4f29-ad76-376d298affd8" released by "delete_volume" :: held 0.876s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:51:11 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-0c250628-cd88-456e-bba6-84c27664b346 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Created reservations ['067ecc99-34c1-4fea-bc95-2cda18ccdfae', '85133891-4c2e-4005-99f7-f22dad95821e', '226b76a7-d376-4419-81ef-d3962101b879', '72e51f5b-dfbb-4ca5-beca-8f906a0a9f7c'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:51:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0c250628-cd88-456e-bba6-84c27664b346 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:51:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0c250628-cd88-456e-bba6-84c27664b346 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:51:11 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0c250628-cd88-456e-bba6-84c27664b346 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:51:11 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-0c250628-cd88-456e-bba6-84c27664b346 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:51:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-0c250628-cd88-456e-bba6-84c27664b346 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:51:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0c250628-cd88-456e-bba6-84c27664b346 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:11 devstack sudo[90871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:51:11 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ef292642-e9ff-4b54-87ee-971aa419ad0b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "cinder-b39d2149-3fba-41f9-ae46-7f8597261f19-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:51:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ef292642-e9ff-4b54-87ee-971aa419ad0b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "cinder-b39d2149-3fba-41f9-ae46-7f8597261f19-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:51:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ef292642-e9ff-4b54-87ee-971aa419ad0b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "cinder-quobyte-b39d2149-3fba-41f9-ae46-7f8597261f19" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:51:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ef292642-e9ff-4b54-87ee-971aa419ad0b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "cinder-quobyte-b39d2149-3fba-41f9-ae46-7f8597261f19" acquired by "delete_volume" :: waited 0.007s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:51:11 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec1ebc6-d88c-456d-a9b7-450d84e75b4e]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:51:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ef292642-e9ff-4b54-87ee-971aa419ad0b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b39d2149-3fba-41f9-ae46-7f8597261f19 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:11 devstack sudo[90873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b39d2149-3fba-41f9-ae46-7f8597261f19 Apr 16 19:51:11 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:11 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-0c250628-cd88-456e-bba6-84c27664b346 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.436s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:11 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-0c250628-cd88-456e-bba6-84c27664b346 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:51:11 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-0c250628-cd88-456e-bba6-84c27664b346 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Deleted volume successfully. Apr 16 19:51:11 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-0c250628-cd88-456e-bba6-84c27664b346 tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "cinder-e36841d4-b029-4f29-ad76-376d298affd8-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:51:11 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ef292642-e9ff-4b54-87ee-971aa419ad0b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b39d2149-3fba-41f9-ae46-7f8597261f19" returned: 0 in 0.469s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:11 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ef292642-e9ff-4b54-87ee-971aa419ad0b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b39d2149-3fba-41f9-ae46-7f8597261f19 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:11 devstack sudo[90879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b39d2149-3fba-41f9-ae46-7f8597261f19 Apr 16 19:51:11 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:12 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ef292642-e9ff-4b54-87ee-971aa419ad0b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b39d2149-3fba-41f9-ae46-7f8597261f19" returned: 0 in 0.404s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:12 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ef292642-e9ff-4b54-87ee-971aa419ad0b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "cinder-quobyte-b39d2149-3fba-41f9-ae46-7f8597261f19" released by "delete_volume" :: held 0.897s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:51:12 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-ef292642-e9ff-4b54-87ee-971aa419ad0b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Created reservations ['aff989ed-0521-4a91-95e4-b9d057330ec7', '26c0defe-5880-4a04-98aa-418fef489e42', '6ebbefd6-bbf5-4242-944c-c9bb159b637a', '8aa4b345-fe58-458c-8db7-a23643ec4e37'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:51:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ef292642-e9ff-4b54-87ee-971aa419ad0b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:51:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ef292642-e9ff-4b54-87ee-971aa419ad0b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:51:12 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ef292642-e9ff-4b54-87ee-971aa419ad0b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:51:12 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-ef292642-e9ff-4b54-87ee-971aa419ad0b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:51:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-ef292642-e9ff-4b54-87ee-971aa419ad0b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:51:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ef292642-e9ff-4b54-87ee-971aa419ad0b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:12 devstack sudo[90882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:51:12 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:12 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-45c9552c-45dc-4588-a81a-787119a49f7e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "cinder-b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474-delete_volume" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:51:12 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-45c9552c-45dc-4588-a81a-787119a49f7e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "cinder-b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:51:12 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-45c9552c-45dc-4588-a81a-787119a49f7e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "cinder-quobyte-b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474" by "delete_volume" {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 19:51:12 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-45c9552c-45dc-4588-a81a-787119a49f7e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "cinder-quobyte-b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474" acquired by "delete_volume" :: waited 0.009s {{(pid=82569) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 19:51:12 devstack cinder-volume[82569]: DEBUG oslo.privsep.daemon [-] privsep: reply[439df6a3-144d-4e88-ab54-d93e04a5cf79]: (4, 'qcow2') {{(pid=83555) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 19:51:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-45c9552c-45dc-4588-a81a-787119a49f7e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:12 devstack sudo[90884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474 Apr 16 19:51:12 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:12 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:12 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-ef292642-e9ff-4b54-87ee-971aa419ad0b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.444s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:12 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-ef292642-e9ff-4b54-87ee-971aa419ad0b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:51:12 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-ef292642-e9ff-4b54-87ee-971aa419ad0b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Deleted volume successfully. Apr 16 19:51:12 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-ef292642-e9ff-4b54-87ee-971aa419ad0b tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "cinder-b39d2149-3fba-41f9-ae46-7f8597261f19-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:51:13 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-45c9552c-45dc-4588-a81a-787119a49f7e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474" returned: 0 in 0.484s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-45c9552c-45dc-4588-a81a-787119a49f7e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:13 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474 Apr 16 19:51:13 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:13 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-45c9552c-45dc-4588-a81a-787119a49f7e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74/volume-b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474" returned: 0 in 0.387s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:13 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-45c9552c-45dc-4588-a81a-787119a49f7e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "cinder-quobyte-b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474" released by "delete_volume" :: held 0.893s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:51:13 devstack cinder-volume[82569]: DEBUG cinder.quota [None req-45c9552c-45dc-4588-a81a-787119a49f7e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Created reservations ['5d2c7189-aabb-4007-9b89-cf0f16b2386c', '53c4f638-b256-4cf2-becf-38786b6239a3', 'b680f384-ff8a-4b50-9240-828e28b921a8', '068a84ab-6fbe-426b-9d94-525c855192d9'] {{(pid=82569) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 19:51:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-45c9552c-45dc-4588-a81a-787119a49f7e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 19:51:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-45c9552c-45dc-4588-a81a-787119a49f7e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 19:51:13 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-45c9552c-45dc-4588-a81a-787119a49f7e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c': None} {{(pid=82569) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 19:51:13 devstack cinder-volume[82569]: DEBUG cinder.volume.drivers.quobyte [None req-45c9552c-45dc-4588-a81a-787119a49f7e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32ef6e48-acad-423e-8eaf-c2c9c62e503c'] {{(pid=82569) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 19:51:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.lockutils [None req-45c9552c-45dc-4588-a81a-787119a49f7e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82569) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 19:51:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-45c9552c-45dc-4588-a81a-787119a49f7e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 19:51:13 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74 Apr 16 19:51:13 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 19:51:13 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Apr 16 19:51:13 devstack cinder-volume[82569]: DEBUG oslo_concurrency.processutils [None req-45c9552c-45dc-4588-a81a-787119a49f7e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e298abbd9bb22d1c3cdf06847a2c1b74" returned: 0 in 0.450s {{(pid=82569) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 19:51:13 devstack cinder-volume[82569]: DEBUG cinder.manager [None req-45c9552c-45dc-4588-a81a-787119a49f7e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Notifying Schedulers of capabilities ... {{(pid=82569) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 19:51:13 devstack cinder-volume[82569]: INFO cinder.volume.manager [None req-45c9552c-45dc-4588-a81a-787119a49f7e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Deleted volume successfully. Apr 16 19:51:13 devstack cinder-volume[82569]: DEBUG cinder.coordination [None req-45c9552c-45dc-4588-a81a-787119a49f7e tempest-CreateVolumesFromSourceVolumeTest-1549727981 None] Lock "cinder-b4d5d1b1-7c4a-4ac9-b7ab-157cd02d4474-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=82569) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 19:51:23 devstack cinder-volume[82569]: DEBUG dbcounter [-] [82569] Writing DB stats cinder:SELECT=120,cinder:UPDATE=178,cinder:INSERT=42,cinder:DELETE=16 {{(pid=82569) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 19:51:23 devstack cinder-volume[82569]: DEBUG dbcounter [-] [82569] Writing DB stats cinder:SELECT=137,cinder:UPDATE=191,cinder:DELETE=13,cinder:INSERT=51 {{(pid=82569) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}